Jul 09 18:39:26.770301 ip-10-0-129-245 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 18:39:26.770315 ip-10-0-129-245 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 18:39:26.770323 ip-10-0-129-245 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 18:39:26.770641 ip-10-0-129-245 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 18:39:37.503995 ip-10-0-129-245 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 09 18:39:37.504009 ip-10-0-129-245 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8e392760d49845fba6396681ede0e771 --
Jul 09 18:41:27.095660 ip-10-0-129-245 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:41:27.422342 ip-10-0-129-245 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:41:27.422342 ip-10-0-129-245 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:41:27.422342 ip-10-0-129-245 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:41:27.422342 ip-10-0-129-245 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:41:27.422342 ip-10-0-129-245 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:41:27.423165 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.423078    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:41:27.426369 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426354    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426370    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426387    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426391    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426394    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426397    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426400    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426403    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426405    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426408    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426411    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426413    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426416    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426419    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:27.426420 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426426    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426429    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426432    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426434    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426437    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426440    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426443    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426445    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426448    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426450    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426453    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426455    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426458    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426460    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426462    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426465    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426467    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426469    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426472    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426474    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:27.426754 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426477    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426479    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426482    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426484    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426487    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426489    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426492    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426495    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426498    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426500    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426502    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426505    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426507    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426510    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426513    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426515    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426518    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426520    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426523    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426525    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:27.427256 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426528    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426530    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426533    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426535    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426538    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426540    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426543    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426545    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426549    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426554    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426558    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426561    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426564    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426566    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426569    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426572    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426575    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426577    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426580    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:27.427760 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426582    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426585    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426587    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426590    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426592    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426595    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426597    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426602    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426604    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426607    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426610    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426613    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426615    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426618    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426621    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426623    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426626    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426628    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426631    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426633    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:27.428211 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426635    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426638    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426641    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426643    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426645    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.426648    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427326    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427332    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427335    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427337    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427345    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427348    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427351    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427353    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427356    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427359    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427362    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427364    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427367    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427369    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:27.428703 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427372    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427374    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427394    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427397    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427399    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427401    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427404    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427406    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427409    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427412    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427414    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427417    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427419    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427422    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427424    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427427    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427430    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427432    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427436    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427439    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:27.429198 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427442    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427445    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427448    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427457    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427460    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427462    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427465    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427468    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427470    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427473    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427476    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427478    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427481    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427483    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427486    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427488    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427491    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427493    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427496    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427498    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:27.429780 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427501    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427503    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427506    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427508    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427511    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427513    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427518    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427521    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427524    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427528    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427531    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427533    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427536    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427539    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427542    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427544    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427552    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427555    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427558    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:27.430286 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427560    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427563    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427565    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427568    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427570    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427572    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427575    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427579    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427582    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427585    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427587    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427590    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427593    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427595    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427598    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427600    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427603    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427605    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:27.430766 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427607    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427610    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427612    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427615    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427617    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427619    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427622    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427624    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427961    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427966    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427969    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427972    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427975    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427977    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427980    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427985    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427988    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427991    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427994    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427997    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:27.431199 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.427999    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428002    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428005    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428007    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428010    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428012    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428015    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428017    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428020    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428022    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428024    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428027    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428031    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428034    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428037    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428040    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428043    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428045    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428048    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:27.431711 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428050    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428053    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428056    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428058    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428061    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428064    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428066    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428071    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428073    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428076    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428078    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428081    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428084    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428088    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428090    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428093    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428095    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428098    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428100    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428103    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:27.432168 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428106    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428108    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428111    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428113    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428117    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428119    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428122    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428124    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428126    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428129    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428131    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428134    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428136    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428138    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428141    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428143    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428146    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428148    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428151    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428155    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:27.432668 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428157    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428160    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428162    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428165    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428167    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428170    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428172    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428175    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428177    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428180    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428182    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428185    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428188    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428190    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428192    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428195    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428198    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428200    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428202    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428205    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:27.433176 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428207    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428210    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428212    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428215    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428218    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428220    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428223    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428225    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428289    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428295    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428300    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428306    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428310    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428313    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428317    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428321    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428324    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428327    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428330    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428333    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428336    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428338    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428341    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:41:27.433665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428345    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428348    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428351    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428355    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428357    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428360    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428363    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428367    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428370    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428373    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428389    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428392    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428395    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428398    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428400    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428403    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428406    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428410    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428413    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428415    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428418    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428421    2578 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428424    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428428    2578 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428431    2578 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:41:27.434255 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428434    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428437    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428440    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428443    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428446    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428449    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428452    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428456    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428459    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428462    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428465    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428467    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428470    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428473    2578 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428476    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428479    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428482    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428485    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428488    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428491    2578 flags.go:64] FLAG: --help="false"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428494    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428497    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428500    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:41:27.434946 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428502    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428505    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428509    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428511    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428514    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428517    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428520    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428523    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428526    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428529    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428532    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428534    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428537    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428540    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428543    2578 flags.go:64] FLAG: --lock-file=""
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428545    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428550    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428553    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428558    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428560    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428563    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428566    2578 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428568    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428572    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:41:27.435940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428575    2578 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428577    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428581    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428584    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428588    2578 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428591    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428594    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428596    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428599    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428602    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428604    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428607    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428614    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428616    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428619    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428622    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428625    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428630    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428632    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428635    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428638    2578 flags.go:64] FLAG: --port="10250"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428641    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428644    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c8b49408c0e10aa"
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428647    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:41:27.436617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428651    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428654    2578 flags.go:64] FLAG: --register-node="true"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428656    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428659    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428662    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428665    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428667    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428671    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428674    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428676    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428679    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428682    2578 flags.go:64] FLAG: --runonce="false"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428684    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428687    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428690    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428692    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428695    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428698    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428701    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428703    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428706    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428710    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428713    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428716    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428720    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:41:27.437191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428723    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428726    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428730    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428733    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428736    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428743    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428746    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428750    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428752    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428755    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428758    2578 flags.go:64] FLAG: --v="2"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428761    2578 flags.go:64] FLAG: --version="false"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428765    2578 flags.go:64] FLAG: --vmodule=""
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428768    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.428771    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428893    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428896    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428899    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428902    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428905    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428908    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428911    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428914    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:27.437812 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428917    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428919    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428922    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428925    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428927    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428931    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428934    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428937    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428939    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428942    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428944    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428947    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428949    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428953    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428956    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428960    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428964    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428966    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428969    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428972    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:27.438431 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428974    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428977    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428979    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428982    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428984    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428987    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428989    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428992    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428994    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.428997    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429000    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429002    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429004    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429007    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429009    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429012    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429014    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429018    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429020    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429023    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:27.438910 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429025    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429028    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429031    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429035    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429039    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429043    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429046    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429049    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429053    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429056    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429058    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429061    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429063    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429066    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429068    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429071    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429073    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429076    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429078    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:27.439394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429081    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429083    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429085    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429088    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429091    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429093    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429096    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429098    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429101    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429103    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429107    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429109    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429112    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429114    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429117    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429119    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429122    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429124    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429127    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429129    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:27.439868 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429132    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429135    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429138    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429140    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429143    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429145    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429148    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429150    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429153    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429155    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429158    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.429160    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.429779    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.437639    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.437654    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:41:27.440351 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.437674    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.437680    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437734    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437740    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437743    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437746    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437749    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437751    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437754    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437758    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437762    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437765    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437768    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437770    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437773    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437776    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437778    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437781    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437783    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:27.440733 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437786    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437788    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437790    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437793    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437795    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437798    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437800    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437803    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437806    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437808    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437810    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437813    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437817    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437820    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437823    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437835    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437839    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437842    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437845    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437848    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:27.441182 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437850    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437853    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437855    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437858    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437861    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437863    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437866    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437868    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437871    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437873    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437876    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437878    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437881    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437883    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437885    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437888    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437890    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437893    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437895    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437898    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:27.441702 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437901    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437905    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437908    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437911    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437914    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437917    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437920    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437923    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437926    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437929    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437931    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437934    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437936    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437939    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437942    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437944    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437947    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437949    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437952    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437954    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:27.442201 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437957    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437959    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437962    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437965    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437967    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437970    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437972    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437974    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437977    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437979    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437982    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437984    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437986    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437989    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437991    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437993    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437996    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.437999    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438001    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:27.442704 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438004    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438007    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438009    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.438014    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438119    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438124    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438128    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438131    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438134    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438137    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438140    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438142    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438145    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438148    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438150    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:27.443151 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438152    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438156    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438158    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438161    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438165    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438168    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438171    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438174    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438177    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438180    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438182    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438185    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438188    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438191    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438194    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438197    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438200    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438202    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:27.443528 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438205    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438207    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438210    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438212    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438215    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438218    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438220    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438222    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438225    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438227    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438230    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438232    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438234    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438237    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438239    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438242    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438245    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438247    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438250    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438252    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:27.443999 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438254    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438257    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438259    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438262    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438264    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438267    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438269    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438272    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438275    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438277    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438279    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438282    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438284    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438287    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438289    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438292    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438294    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438297    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438299    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438302    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:27.444485 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438304    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438307    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438309    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438311    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438314    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438316    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438319    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438321    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438323    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438327    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438329    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438332    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438334    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438337    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438339    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438342    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438344    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438346    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438349    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438351    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:27.444971 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438355    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438358    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438361    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438363    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438366    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438368    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438370    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438373    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438390    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:27.438393    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.438398    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.438494    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.441322    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.442673    2578 server.go:1019] "Starting client certificate rotation"
Jul 09 18:41:27.445467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.442772    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:41:27.445845 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.442812    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:41:27.445845 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.444707    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:41:27.445930 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.445895    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:41:27.455160 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.455144    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:41:27.458343 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.458329    2578 log.go:25] "Validated CRI v1 image API"
Jul 09 18:41:27.459187 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.459158    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:41:27.461863 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.461838    2578 fs.go:135] Filesystem UUIDs: map[2fdb53cb-4656-4ef9-9ec7-ed4ae5d0e2bf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d75d0691-18f6-484d-ab67-0497ecb7b577:/dev/nvme0n1p3]
Jul 09 18:41:27.461922 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.461862    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:41:27.466551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.466454    2578 manager.go:216] Machine: {Timestamp:2026-07-09 18:41:27.465195869 +0000 UTC m=+0.274042294 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100033 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cbd4b36c160aac2dc8fd320a6045a SystemUUID:ec2cbd4b-36c1-60aa-c2dc-8fd320a6045a BootID:8e392760-d498-45fb-a639-6681ede0e771 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:76:23:f3:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:76:23:f3:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:9c:3a:a8:82:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:41:27.466551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.466546    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:41:27.466656 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.466610    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:41:27.469881 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.469673    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:41:27.470064 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.469891    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:41:27.470766 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.470754    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:41:27.470803 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.470770    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:41:27.470803 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.470778    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:41:27.471359 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.471349    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:41:27.472350 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.472341    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:41:27.476266 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476252    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:41:27.476391 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476370    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:41:27.476438 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476417    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:41:27.476438 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476428    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:41:27.476490 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476441    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:41:27.476490 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476450    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:41:27.476490 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476459    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:41:27.476741 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476719    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:41:27.476741 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.476743    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:41:27.478673 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.478653    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:41:27.479261 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.479243    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:41:27.480455 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.480442    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:41:27.480518 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.480471    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:41:27.481112 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481101    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481117    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481122    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481128    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481135    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481140    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481148    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481152    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481158    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:41:27.481162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481163    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:41:27.481455 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481172    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:41:27.481455 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481177    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:41:27.481765 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481754    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:41:27.481765 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.481765    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:41:27.484987 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.484973    2578 server.go:1268] "Started kubelet"
Jul 09 18:41:27.485055 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.485035    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:41:27.485195 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.485130    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:41:27.485258 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.485217    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:41:27.485797 ip-10-0-129-245 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:41:27.487514 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.486785    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:41:27.487514 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.487135    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:41:27.488059 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.488039    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:41:27.488190 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.488172    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:41:27.488259 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.488218    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:41:27.490118 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.490088    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:41:27.492141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492126    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:41:27.492141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492139    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:41:27.492637 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.491479    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-245.ec2.internal.18c0b333cbf046ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-245.ec2.internal,UID:ip-10-0-129-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-245.ec2.internal,},FirstTimestamp:2026-07-09 18:41:27.484942079 +0000 UTC m=+0.293788505,LastTimestamp:2026-07-09 18:41:27.484942079 +0000 UTC m=+0.293788505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-245.ec2.internal,}"
Jul 09 18:41:27.492637 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.492319    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:27.492851 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492826    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:41:27.492927 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492894    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:41:27.492927 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492911    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:41:27.493017 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492947    2578 factory.go:55] Registering systemd factory
Jul 09 18:41:27.493017 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.492981    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:41:27.493017 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493011    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:41:27.493137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493024    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:41:27.493178 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493165    2578 factory.go:153] Registering CRI-O factory
Jul 09 18:41:27.493178 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493177    2578 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:41:27.493271 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493213    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:41:27.493271 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493231    2578 factory.go:103] Registering Raw factory
Jul 09 18:41:27.493271 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493244    2578 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:41:27.493832 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.493809    2578 manager.go:349] Starting recovery of all containers
Jul 09 18:41:27.501837 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.501782    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:41:27.502160 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.501945    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:41:27.507136 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.507111    2578 manager.go:354] Recovery completed
Jul 09 18:41:27.511472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.511367    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.515369 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515343    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.515468 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515401    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.515468 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515417    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.515641 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515621    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfj8t"
Jul 09 18:41:27.515910 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515898    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:41:27.515968 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515909    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:41:27.515968 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515928    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.515968 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.515936    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:41:27.516612 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.516594    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.516672 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.516625    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.516672 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.516638    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.517497 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.517433    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-245.ec2.internal.18c0b333cdc08ba5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-245.ec2.internal,UID:ip-10-0-129-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-245.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-245.ec2.internal,},FirstTimestamp:2026-07-09 18:41:27.515368357 +0000 UTC m=+0.324214785,LastTimestamp:2026-07-09 18:41:27.515368357 +0000 UTC m=+0.324214785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-245.ec2.internal,}"
Jul 09 18:41:27.518052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.518038    2578 policy_none.go:49] "None policy: Start"
Jul 09 18:41:27.518052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.518054    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:41:27.518158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.518065    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:41:27.520069 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.520058    2578 policy_none.go:47] "Start"
Jul 09 18:41:27.522724 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.522705    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfj8t"
Jul 09 18:41:27.529304 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.529245    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-245.ec2.internal.18c0b333cdc12918  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-245.ec2.internal,UID:ip-10-0-129-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-245.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-245.ec2.internal,},FirstTimestamp:2026-07-09 18:41:27.515408664 +0000 UTC m=+0.324255094,LastTimestamp:2026-07-09 18:41:27.515408664 +0000 UTC m=+0.324255094,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-245.ec2.internal,}"
Jul 09 18:41:27.557934 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.557919    2578 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:41:27.558013 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.557950    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:41:27.558013 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.557960    2578 server.go:87] "Starting device plugin registration server"
Jul 09 18:41:27.558164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.558149    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:41:27.558263 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.558174    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:41:27.558317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.558284    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:41:27.558364 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.558352    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:41:27.558364 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.558358    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:41:27.558908 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.558890    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:41:27.558972 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.558942    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:27.631742 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.631719    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:41:27.633902 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.633027    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:41:27.633902 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.633060    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:41:27.633902 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.633076    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:41:27.633902 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.633105    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:41:27.635646 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.635629    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:27.658675 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.658658    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.659364 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.659348    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.659439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.659395    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.659439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.659411    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.659439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.659435    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.673396 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.673348    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.673396 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.673365    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-245.ec2.internal\": node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:27.703451 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.703429    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:27.733712 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.733692    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"]
Jul 09 18:41:27.733768 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.733742    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.734972 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.734959    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.735029 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.734982    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.735029 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.734994    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.737288 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.737276    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.737456 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.737440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.737503 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.737475    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.738011 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.737980    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.738085 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.738021    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.738085 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.738032    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.739101 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.739084    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.739185 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.739115    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.739185 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.739129    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.741282 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.741266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.741366 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.741295    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:27.741947 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.741933    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:27.742026 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.741963    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:27.742026 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.741979    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:27.753880 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.753862    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-245.ec2.internal\" not found" node="ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.759206 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.759192    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-245.ec2.internal\" not found" node="ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.795260 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.795239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e71da175edc53f23463ed6dcccdf14e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal\" (UID: \"6e71da175edc53f23463ed6dcccdf14e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.795334 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.795265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e71da175edc53f23463ed6dcccdf14e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal\" (UID: \"6e71da175edc53f23463ed6dcccdf14e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.795334 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.795282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c268e93e8c7930ec1c5d8f84479e66a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-245.ec2.internal\" (UID: \"3c268e93e8c7930ec1c5d8f84479e66a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.804341 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.804325    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:27.895792 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.895767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e71da175edc53f23463ed6dcccdf14e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal\" (UID: \"6e71da175edc53f23463ed6dcccdf14e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.895891 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.895797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e71da175edc53f23463ed6dcccdf14e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal\" (UID: \"6e71da175edc53f23463ed6dcccdf14e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.895891 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.895820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c268e93e8c7930ec1c5d8f84479e66a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-245.ec2.internal\" (UID: \"3c268e93e8c7930ec1c5d8f84479e66a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.895891 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.895863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c268e93e8c7930ec1c5d8f84479e66a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-245.ec2.internal\" (UID: \"3c268e93e8c7930ec1c5d8f84479e66a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.895891 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.895865    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e71da175edc53f23463ed6dcccdf14e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal\" (UID: \"6e71da175edc53f23463ed6dcccdf14e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.895891 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:27.895882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e71da175edc53f23463ed6dcccdf14e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal\" (UID: \"6e71da175edc53f23463ed6dcccdf14e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:27.904890 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:27.904869    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.005253 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.005193    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.055369 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.055346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:28.062030 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.062013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:28.106178 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.106156    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.206649 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.206622    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.307420 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.307351    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.312442 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.312413    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:28.408427 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.408399    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.442590 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.442564    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:41:28.443107 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.442718    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:41:28.443107 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.442765    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:41:28.508960 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.508937    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.527790 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.527763    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:36:28 +0000 UTC" deadline="2028-03-12 14:42:50.917531931 +0000 UTC"
Jul 09 18:41:28.527790 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.527788    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14684h1m22.389746301s"
Jul 09 18:41:28.565128 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.565111    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:28.566259 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.566240    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:28.566341 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.566276    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:28.566341 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.566287    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:28.570050 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:28.570019    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c268e93e8c7930ec1c5d8f84479e66a.slice/crio-e0cc9cb61501498a22fbad884c9769c9298bf329f53a96b2d6ac35255b03f90d WatchSource:0}: Error finding container e0cc9cb61501498a22fbad884c9769c9298bf329f53a96b2d6ac35255b03f90d: Status 404 returned error can't find the container with id e0cc9cb61501498a22fbad884c9769c9298bf329f53a96b2d6ac35255b03f90d
Jul 09 18:41:28.570564 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:28.570550    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e71da175edc53f23463ed6dcccdf14e.slice/crio-70c9234793e7764a2aae1a64533f3c911542f5b703d39a07e8038808f2f89f34 WatchSource:0}: Error finding container 70c9234793e7764a2aae1a64533f3c911542f5b703d39a07e8038808f2f89f34: Status 404 returned error can't find the container with id 70c9234793e7764a2aae1a64533f3c911542f5b703d39a07e8038808f2f89f34
Jul 09 18:41:28.574893 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.574878    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:41:28.609830 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.609805    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.635775 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.635739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal" event={"ID":"6e71da175edc53f23463ed6dcccdf14e","Type":"ContainerStarted","Data":"70c9234793e7764a2aae1a64533f3c911542f5b703d39a07e8038808f2f89f34"}
Jul 09 18:41:28.636771 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.636730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal" event={"ID":"3c268e93e8c7930ec1c5d8f84479e66a","Type":"ContainerStarted","Data":"e0cc9cb61501498a22fbad884c9769c9298bf329f53a96b2d6ac35255b03f90d"}
Jul 09 18:41:28.710207 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.710176    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.810949 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:28.810912    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-245.ec2.internal\" not found"
Jul 09 18:41:28.819963 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.819918    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:28.897494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.897471    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:28.912371 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.912348    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:41:28.913478 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.913453    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal"
Jul 09 18:41:28.925573 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.925552    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:28.926040 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:28.926024    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:41:29.381654 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.381630    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:29.479532 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.479504    2578 apiserver.go:52] "Watching apiserver"
Jul 09 18:41:29.492272 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.492247    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:41:29.492696 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.492674    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gbqlb","kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb","openshift-cluster-node-tuning-operator/tuned-b28rh","openshift-dns/node-resolver-tnbw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal","openshift-multus/multus-m87nd","openshift-image-registry/node-ca-lv4fg","openshift-multus/multus-additional-cni-plugins-ghclz","openshift-multus/network-metrics-daemon-m72t8","openshift-network-diagnostics/network-check-target-kl8gq","openshift-network-operator/iptables-alerter-xwdxf","openshift-ovn-kubernetes/ovnkube-node-s685n","kube-system/global-pull-secret-syncer-2kztj"]
Jul 09 18:41:29.492944 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.492926    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:41:29.495185 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.495169    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.497592 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.497566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.498824 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.498800    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.498942 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.498901    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4phjb\""
Jul 09 18:41:29.499161 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.499124    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.499290 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.499194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:41:29.499290 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.499197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:41:29.500296 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.500048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.502545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.502416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.503346 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.503322    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.503478 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.503357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.503639 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.503618    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:41:29.504033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.504012    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:41:29.504770 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.504752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:41:29.505056 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.505033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:41:29.505444 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.505420    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jgnzc\""
Jul 09 18:41:29.505682 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.505666    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:41:29.505997 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.505978    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.506050 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.506034    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.506310 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.506293    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qckbz\""
Jul 09 18:41:29.506837 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.506818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.506874 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.506857    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.507180 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507165    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g2ltf\""
Jul 09 18:41:29.507227 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-hostroot\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507266 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-conf-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507301 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-multus-certs\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507337 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-etc-kubernetes\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507370 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-socket-dir-parent\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-daemon-config\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507547 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbff7\" (UniqueName: \"kubernetes.io/projected/b5351b00-be0e-4a27-907f-5d3fb9e4c529-kube-api-access-mbff7\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507678 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-netns\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507678 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-kubelet\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507678 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.507852 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-cni-bin\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507852 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-system-cni-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.507852 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.507852 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-cnibin\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.508086 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-os-release\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.508086 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5351b00-be0e-4a27-907f-5d3fb9e4c529-cni-binary-copy\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.508086 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.507958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-k8s-cni-cncf-io\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.508086 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.507963    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:29.508086 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.508028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-cni-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.508086 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.508069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-cni-multus\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.509494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.509472    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:41:29.511334 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.511308    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.511334 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.511329    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.511512 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.511339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zrm68\""
Jul 09 18:41:29.511850 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.511833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.514283 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.514261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.515174 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.515149    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:41:29.515174 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.515167    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:41:29.515348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.515203    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lqqx\""
Jul 09 18:41:29.516824 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.516803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.517485 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.517465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:41:29.517762 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.517744    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:41:29.517845 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.517808    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-592xc\""
Jul 09 18:41:29.519260 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.519238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:29.519361 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.519322    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:29.520583 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.520557    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:41:29.520724 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.520567    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.520724 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.520569    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.520902 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.520703    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjzxm\""
Jul 09 18:41:29.522271 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.522249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:29.522354 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.522316    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:29.524716 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.524698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.528518 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.528467    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:41:29.528617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.528567    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:41:29.528617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.528569    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xdsq6\""
Jul 09 18:41:29.528700 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.528613    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:41:29.534766 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.534738    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmw4w"
Jul 09 18:41:29.542299 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.542271    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmw4w"
Jul 09 18:41:29.594544 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.594525    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:41:29.608654 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-ovnkube-script-lib\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.608758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-socket-dir-parent\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.608758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbff7\" (UniqueName: \"kubernetes.io/projected/b5351b00-be0e-4a27-907f-5d3fb9e4c529-kube-api-access-mbff7\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.608758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:29.608758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-modprobe-d\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.608979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-socket-dir-parent\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.608979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysctl-conf\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.608979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff676955-44dc-425e-8060-3baca082807a-tmp-dir\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.608979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.608979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-system-cni-dir\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.608979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-host\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.608980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-cni-bin\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5351b00-be0e-4a27-907f-5d3fb9e4c529-cni-binary-copy\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-cni-bin\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-var-lib-kubelet\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-tuned\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cnibin\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.609248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff676955-44dc-425e-8060-3baca082807a-hosts-file\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-daemon-config\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-kubernetes\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysctl-d\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8751e110-a548-4539-8e9b-6748fdf7e246-serviceca\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-etc-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.609686 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysconfig\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-systemd\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-run-ovn-kubernetes\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/809f082e-d099-4758-b605-f4d76eedd980-kubelet-config\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-system-cni-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-os-release\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.609935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-system-cni-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-os-release\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbgtx\" (UniqueName: \"kubernetes.io/projected/e8e88489-f037-4b40-a4c8-e77b72bf5e40-kube-api-access-fbgtx\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-daemon-config\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-cni-multus\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k47cv\" (UniqueName: \"kubernetes.io/projected/e9123ce4-5241-47ce-a907-4c44d9e87605-kube-api-access-k47cv\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-cni-multus\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-kubelet\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-slash\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5351b00-be0e-4a27-907f-5d3fb9e4c529-cni-binary-copy\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.610990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-cni-netd\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cmzr\" (UniqueName: \"kubernetes.io/projected/48d4d772-ffbd-4222-bf8d-537649eb0379-kube-api-access-2cmzr\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8751e110-a548-4539-8e9b-6748fdf7e246-host\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.610990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-iptables-alerter-script\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.610990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-ovn\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.610990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.610976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-kubelet\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4tqm\" (UniqueName: \"kubernetes.io/projected/4f95b2e4-8515-44d0-98d6-181121eebbb4-kube-api-access-j4tqm\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc95cb71-a45f-4706-9302-bc7a09bcbc73-konnectivity-ca\") pod \"konnectivity-agent-gbqlb\" (UID: \"cc95cb71-a45f-4706-9302-bc7a09bcbc73\") " pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-run-netns\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-node-log\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4855j\" (UniqueName: \"kubernetes.io/projected/8751e110-a548-4539-8e9b-6748fdf7e246-kube-api-access-4855j\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-device-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-cnibin\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-etc-kubernetes\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/809f082e-d099-4758-b605-f4d76eedd980-dbus\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-os-release\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-var-lib-kubelet\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d74d83d-a040-4ffd-8610-8e0c4191006f-tmp\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-etc-kubernetes\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-cnibin\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-cni-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-conf-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-multus-certs\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-log-socket\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48d4d772-ffbd-4222-bf8d-537649eb0379-ovn-node-metrics-cert\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-run\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-host-slash\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqjb\" (UniqueName: \"kubernetes.io/projected/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-kube-api-access-dcqjb\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.611808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-cni-bin\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-ovnkube-config\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-sys\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zc2k\" (UniqueName: \"kubernetes.io/projected/6d74d83d-a040-4ffd-8610-8e0c4191006f-kube-api-access-5zc2k\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-netns\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-systemd-units\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-var-lib-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-env-overrides\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.611998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-k8s-cni-cncf-io\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc95cb71-a45f-4706-9302-bc7a09bcbc73-agent-certs\") pod \"konnectivity-agent-gbqlb\" (UID: \"cc95cb71-a45f-4706-9302-bc7a09bcbc73\") " pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-systemd\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-lib-modules\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfb96\" (UniqueName: \"kubernetes.io/projected/ff676955-44dc-425e-8060-3baca082807a-kube-api-access-hfb96\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-hostroot\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.612580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.613309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.613309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.612956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-cni-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.613309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.613155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-multus-conf-dir\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.613309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.613196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-multus-certs\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.613531 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.613437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-netns\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.613760 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.613737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-hostroot\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.613862 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.613841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5351b00-be0e-4a27-907f-5d3fb9e4c529-host-run-k8s-cni-cncf-io\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.619270 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.618953    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:41:29.622857 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.622832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbff7\" (UniqueName: \"kubernetes.io/projected/b5351b00-be0e-4a27-907f-5d3fb9e4c529-kube-api-access-mbff7\") pod \"multus-m87nd\" (UID: \"b5351b00-be0e-4a27-907f-5d3fb9e4c529\") " pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.713114 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-ovnkube-config\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.713114 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-sys\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713114 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zc2k\" (UniqueName: \"kubernetes.io/projected/6d74d83d-a040-4ffd-8610-8e0c4191006f-kube-api-access-5zc2k\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-systemd-units\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-var-lib-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-env-overrides\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc95cb71-a45f-4706-9302-bc7a09bcbc73-agent-certs\") pod \"konnectivity-agent-gbqlb\" (UID: \"cc95cb71-a45f-4706-9302-bc7a09bcbc73\") " pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-systemd\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-lib-modules\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfb96\" (UniqueName: \"kubernetes.io/projected/ff676955-44dc-425e-8060-3baca082807a-kube-api-access-hfb96\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.713317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-ovnkube-script-lib\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-modprobe-d\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysctl-conf\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff676955-44dc-425e-8060-3baca082807a-tmp-dir\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-system-cni-dir\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-host\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-var-lib-kubelet\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-tuned\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cnibin\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff676955-44dc-425e-8060-3baca082807a-hosts-file\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-kubernetes\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysctl-d\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.713892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8751e110-a548-4539-8e9b-6748fdf7e246-serviceca\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-etc-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysconfig\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-systemd\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-run-ovn-kubernetes\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/809f082e-d099-4758-b605-f4d76eedd980-kubelet-config\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbgtx\" (UniqueName: \"kubernetes.io/projected/e8e88489-f037-4b40-a4c8-e77b72bf5e40-kube-api-access-fbgtx\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k47cv\" (UniqueName: \"kubernetes.io/projected/e9123ce4-5241-47ce-a907-4c44d9e87605-kube-api-access-k47cv\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-kubelet\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-slash\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-cni-netd\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cmzr\" (UniqueName: \"kubernetes.io/projected/48d4d772-ffbd-4222-bf8d-537649eb0379-kube-api-access-2cmzr\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8751e110-a548-4539-8e9b-6748fdf7e246-host\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-iptables-alerter-script\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.714817 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-ovn\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-ovnkube-config\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4tqm\" (UniqueName: \"kubernetes.io/projected/4f95b2e4-8515-44d0-98d6-181121eebbb4-kube-api-access-j4tqm\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc95cb71-a45f-4706-9302-bc7a09bcbc73-konnectivity-ca\") pod \"konnectivity-agent-gbqlb\" (UID: \"cc95cb71-a45f-4706-9302-bc7a09bcbc73\") " pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-sys\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-run-netns\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-node-log\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-systemd-units\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4855j\" (UniqueName: \"kubernetes.io/projected/8751e110-a548-4539-8e9b-6748fdf7e246-kube-api-access-4855j\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-device-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-var-lib-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/809f082e-d099-4758-b605-f4d76eedd980-dbus\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-os-release\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d74d83d-a040-4ffd-8610-8e0c4191006f-tmp\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:29.715694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-log-socket\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48d4d772-ffbd-4222-bf8d-537649eb0379-ovn-node-metrics-cert\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-run\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-host-slash\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqjb\" (UniqueName: \"kubernetes.io/projected/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-kube-api-access-dcqjb\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-cni-bin\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-env-overrides\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-cni-bin\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.714816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.715274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48d4d772-ffbd-4222-bf8d-537649eb0379-ovnkube-script-lib\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.715382    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.715479    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:30.215436088 +0000 UTC m=+3.024282518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.715735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-modprobe-d\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.715859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysctl-conf\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.715988    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-systemd\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-lib-modules\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff676955-44dc-425e-8060-3baca082807a-tmp-dir\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.716545 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-system-cni-dir\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-host\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.716956    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.717016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8751e110-a548-4539-8e9b-6748fdf7e246-host\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.717025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-var-lib-kubelet\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.717158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.717061    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-ovn\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.717405 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.717361    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:29.717480 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.717410    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:30.217393569 +0000 UTC m=+3.026239984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:29.717543 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.717519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-iptables-alerter-script\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.717918 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.717891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc95cb71-a45f-4706-9302-bc7a09bcbc73-agent-certs\") pod \"konnectivity-agent-gbqlb\" (UID: \"cc95cb71-a45f-4706-9302-bc7a09bcbc73\") " pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.718031 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.717980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc95cb71-a45f-4706-9302-bc7a09bcbc73-konnectivity-ca\") pod \"konnectivity-agent-gbqlb\" (UID: \"cc95cb71-a45f-4706-9302-bc7a09bcbc73\") " pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.718031 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-os-release\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.718317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-log-socket\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.718516 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.718601 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cnibin\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.718666 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff676955-44dc-425e-8060-3baca082807a-hosts-file\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.718897 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-run-netns\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.718897 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8e88489-f037-4b40-a4c8-e77b72bf5e40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.718897 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-kubernetes\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.718897 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.713683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-node-log\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysctl-d\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.719164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-etc-openvswitch\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.718979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.719164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.719164 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f95b2e4-8515-44d0-98d6-181121eebbb4-device-dir\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.719616 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-host-slash\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.719616 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719220    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-run\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.719616 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8751e110-a548-4539-8e9b-6748fdf7e246-serviceca\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.719616 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-run-ovn-kubernetes\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719616 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/809f082e-d099-4758-b605-f4d76eedd980-kubelet-config\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-kubelet\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/809f082e-d099-4758-b605-f4d76eedd980-dbus\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8e88489-f037-4b40-a4c8-e77b72bf5e40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-sysconfig\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-slash\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-run-systemd\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.719907 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.719779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48d4d772-ffbd-4222-bf8d-537649eb0379-host-cni-netd\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.721154 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.721126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48d4d772-ffbd-4222-bf8d-537649eb0379-ovn-node-metrics-cert\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.722224 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.722170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d74d83d-a040-4ffd-8610-8e0c4191006f-etc-tuned\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.722997 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.722973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d74d83d-a040-4ffd-8610-8e0c4191006f-tmp\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.729798 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.729778    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:29.729908 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.729803    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:29.729908 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.729818    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:29.729908 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:29.729888    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:30.229871824 +0000 UTC m=+3.038718239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:29.730858 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.730839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4tqm\" (UniqueName: \"kubernetes.io/projected/4f95b2e4-8515-44d0-98d6-181121eebbb4-kube-api-access-j4tqm\") pod \"aws-ebs-csi-driver-node-znbrb\" (UID: \"4f95b2e4-8515-44d0-98d6-181121eebbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.733390 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.733363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4855j\" (UniqueName: \"kubernetes.io/projected/8751e110-a548-4539-8e9b-6748fdf7e246-kube-api-access-4855j\") pod \"node-ca-lv4fg\" (UID: \"8751e110-a548-4539-8e9b-6748fdf7e246\") " pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.734096 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.734073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfb96\" (UniqueName: \"kubernetes.io/projected/ff676955-44dc-425e-8060-3baca082807a-kube-api-access-hfb96\") pod \"node-resolver-tnbw4\" (UID: \"ff676955-44dc-425e-8060-3baca082807a\") " pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.734224 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.734200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cmzr\" (UniqueName: \"kubernetes.io/projected/48d4d772-ffbd-4222-bf8d-537649eb0379-kube-api-access-2cmzr\") pod \"ovnkube-node-s685n\" (UID: \"48d4d772-ffbd-4222-bf8d-537649eb0379\") " pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.734942 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.734917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqjb\" (UniqueName: \"kubernetes.io/projected/3c97fc31-9524-43c2-8d41-dbbc6b06db3e-kube-api-access-dcqjb\") pod \"iptables-alerter-xwdxf\" (UID: \"3c97fc31-9524-43c2-8d41-dbbc6b06db3e\") " pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.735604 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.735579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k47cv\" (UniqueName: \"kubernetes.io/projected/e9123ce4-5241-47ce-a907-4c44d9e87605-kube-api-access-k47cv\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:29.736158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.736139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zc2k\" (UniqueName: \"kubernetes.io/projected/6d74d83d-a040-4ffd-8610-8e0c4191006f-kube-api-access-5zc2k\") pod \"tuned-b28rh\" (UID: \"6d74d83d-a040-4ffd-8610-8e0c4191006f\") " pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.739624 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.739583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbgtx\" (UniqueName: \"kubernetes.io/projected/e8e88489-f037-4b40-a4c8-e77b72bf5e40-kube-api-access-fbgtx\") pod \"multus-additional-cni-plugins-ghclz\" (UID: \"e8e88489-f037-4b40-a4c8-e77b72bf5e40\") " pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.811453 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.811249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m87nd"
Jul 09 18:41:29.817527 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.817505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:29.826470 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.826428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb"
Jul 09 18:41:29.832821 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.831620    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b28rh"
Jul 09 18:41:29.837396 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.837370    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f95b2e4_8515_44d0_98d6_181121eebbb4.slice/crio-e866858cabc7fe8311264ceca2741808f1dcaa4df7bf1bb0f105a554e7cd0fcd WatchSource:0}: Error finding container e866858cabc7fe8311264ceca2741808f1dcaa4df7bf1bb0f105a554e7cd0fcd: Status 404 returned error can't find the container with id e866858cabc7fe8311264ceca2741808f1dcaa4df7bf1bb0f105a554e7cd0fcd
Jul 09 18:41:29.838671 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.838621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tnbw4"
Jul 09 18:41:29.842915 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.842889    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d74d83d_a040_4ffd_8610_8e0c4191006f.slice/crio-53957d47bb65272026c77e45057f7747add408e330a8a5bad365e9cee9fea606 WatchSource:0}: Error finding container 53957d47bb65272026c77e45057f7747add408e330a8a5bad365e9cee9fea606: Status 404 returned error can't find the container with id 53957d47bb65272026c77e45057f7747add408e330a8a5bad365e9cee9fea606
Jul 09 18:41:29.845651 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.845628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ghclz"
Jul 09 18:41:29.850815 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.850755    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff676955_44dc_425e_8060_3baca082807a.slice/crio-b213dc2e4a650b471ea3dbcaf306959030766c164fdc15c355d04601a73dee92 WatchSource:0}: Error finding container b213dc2e4a650b471ea3dbcaf306959030766c164fdc15c355d04601a73dee92: Status 404 returned error can't find the container with id b213dc2e4a650b471ea3dbcaf306959030766c164fdc15c355d04601a73dee92
Jul 09 18:41:29.854583 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.854560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:29.857073 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.857048    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e88489_f037_4b40_a4c8_e77b72bf5e40.slice/crio-42f8a500cb1cd077a3726924b4a8593d0bdf10257aa96c7e5f238708edfe27ba WatchSource:0}: Error finding container 42f8a500cb1cd077a3726924b4a8593d0bdf10257aa96c7e5f238708edfe27ba: Status 404 returned error can't find the container with id 42f8a500cb1cd077a3726924b4a8593d0bdf10257aa96c7e5f238708edfe27ba
Jul 09 18:41:29.861137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.861117    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lv4fg"
Jul 09 18:41:29.866270 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.866242    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc95cb71_a45f_4706_9302_bc7a09bcbc73.slice/crio-5f728bcb4e1a46a9de15624d56e3cd557dc46b5aac075f4f2fd52bf30db8da6f WatchSource:0}: Error finding container 5f728bcb4e1a46a9de15624d56e3cd557dc46b5aac075f4f2fd52bf30db8da6f: Status 404 returned error can't find the container with id 5f728bcb4e1a46a9de15624d56e3cd557dc46b5aac075f4f2fd52bf30db8da6f
Jul 09 18:41:29.869502 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:29.869480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwdxf"
Jul 09 18:41:29.871925 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.871905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8751e110_a548_4539_8e9b_6748fdf7e246.slice/crio-6f75f183a679bd3dd76b9bd55ebb2fe09857b5b8c1ea9139a1c09da7b1c2eb57 WatchSource:0}: Error finding container 6f75f183a679bd3dd76b9bd55ebb2fe09857b5b8c1ea9139a1c09da7b1c2eb57: Status 404 returned error can't find the container with id 6f75f183a679bd3dd76b9bd55ebb2fe09857b5b8c1ea9139a1c09da7b1c2eb57
Jul 09 18:41:29.884865 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:41:29.884833    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c97fc31_9524_43c2_8d41_dbbc6b06db3e.slice/crio-bf1e11140b48c2918a2c7e083499eb43d0090b40cc3e01a973efe9bf2791f78f WatchSource:0}: Error finding container bf1e11140b48c2918a2c7e083499eb43d0090b40cc3e01a973efe9bf2791f78f: Status 404 returned error can't find the container with id bf1e11140b48c2918a2c7e083499eb43d0090b40cc3e01a973efe9bf2791f78f
Jul 09 18:41:30.219348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.219319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:30.219522 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.219390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:30.219522 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.219512    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:30.219598 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.219576    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:31.219558462 +0000 UTC m=+4.028404881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:30.219653 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.219513    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:30.219726 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.219672    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:31.21965088 +0000 UTC m=+4.028497319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:30.319869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.319833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:30.320048 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.320020    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:30.320048 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.320047    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:30.320197 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.320059    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:30.320197 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.320112    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:31.320096574 +0000 UTC m=+4.128942990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:30.545639 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.545506    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:36:30 +0000 UTC" deadline="2028-02-02 02:23:13.027517671 +0000 UTC"
Jul 09 18:41:30.545639 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.545578    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13735h41m42.48194413s"
Jul 09 18:41:30.634181 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.633692    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:30.634181 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:30.633807    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:30.641920 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.641847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tnbw4" event={"ID":"ff676955-44dc-425e-8060-3baca082807a","Type":"ContainerStarted","Data":"b213dc2e4a650b471ea3dbcaf306959030766c164fdc15c355d04601a73dee92"}
Jul 09 18:41:30.644882 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.644805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b28rh" event={"ID":"6d74d83d-a040-4ffd-8610-8e0c4191006f","Type":"ContainerStarted","Data":"53957d47bb65272026c77e45057f7747add408e330a8a5bad365e9cee9fea606"}
Jul 09 18:41:30.646743 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.646707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb" event={"ID":"4f95b2e4-8515-44d0-98d6-181121eebbb4","Type":"ContainerStarted","Data":"e866858cabc7fe8311264ceca2741808f1dcaa4df7bf1bb0f105a554e7cd0fcd"}
Jul 09 18:41:30.648589 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.648521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m87nd" event={"ID":"b5351b00-be0e-4a27-907f-5d3fb9e4c529","Type":"ContainerStarted","Data":"8b6db7f332e070c6878471e56b192eee6cb68f432e56ad316b60aa1ccadec985"}
Jul 09 18:41:30.650206 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.650132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwdxf" event={"ID":"3c97fc31-9524-43c2-8d41-dbbc6b06db3e","Type":"ContainerStarted","Data":"bf1e11140b48c2918a2c7e083499eb43d0090b40cc3e01a973efe9bf2791f78f"}
Jul 09 18:41:30.652441 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.652352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lv4fg" event={"ID":"8751e110-a548-4539-8e9b-6748fdf7e246","Type":"ContainerStarted","Data":"6f75f183a679bd3dd76b9bd55ebb2fe09857b5b8c1ea9139a1c09da7b1c2eb57"}
Jul 09 18:41:30.654365 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.654305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbqlb" event={"ID":"cc95cb71-a45f-4706-9302-bc7a09bcbc73","Type":"ContainerStarted","Data":"5f728bcb4e1a46a9de15624d56e3cd557dc46b5aac075f4f2fd52bf30db8da6f"}
Jul 09 18:41:30.656429 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.656384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerStarted","Data":"42f8a500cb1cd077a3726924b4a8593d0bdf10257aa96c7e5f238708edfe27ba"}
Jul 09 18:41:30.658026 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.657962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"baf5ade1dd5937c4dd48c277abd514e9a52f15c1be5e18afe949272f12d7974c"}
Jul 09 18:41:30.919112 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:30.919084    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:31.228505 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.227819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:31.228505 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.227913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:31.228505 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.228060    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:31.228505 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.228122    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:33.22810394 +0000 UTC m=+6.036950356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:31.228837 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.228559    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:31.228837 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.228612    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:33.22859585 +0000 UTC m=+6.037442267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:31.329068 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.329027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:31.329286 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.329239    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:31.329286 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.329268    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:31.329286 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.329282    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:31.329495 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.329343    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:33.329323734 +0000 UTC m=+6.138170163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:31.546632 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.546542    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:36:30 +0000 UTC" deadline="2028-04-11 00:22:25.68920098 +0000 UTC"
Jul 09 18:41:31.546632 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.546583    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15389h40m54.142623158s"
Jul 09 18:41:31.635940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.635907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:31.636110 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.636049    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:31.636520 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:31.636499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:31.636660 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:31.636615    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:32.634842 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:32.634295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:32.634842 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:32.634458    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:33.246581 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:33.246540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:33.246771 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:33.246629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:33.246771 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.246752    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:33.246876 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.246803    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:37.246788727 +0000 UTC m=+10.055635145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:33.246876 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.246848    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:33.246876 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.246870    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:37.24686341 +0000 UTC m=+10.055709825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:33.347968 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:33.347930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:33.348168 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.348089    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:33.348168 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.348111    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:33.348168 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.348124    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:33.348347 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.348180    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:37.348161012 +0000 UTC m=+10.157007432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:33.635320 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:33.634506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:33.635320 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.634640    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:33.635320 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:33.635096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:33.635320 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:33.635221    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:34.634187 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:34.634089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:34.634354 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:34.634255    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:35.633797 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:35.633693    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:35.634193 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:35.633840    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:35.634193 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:35.633915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:35.634193 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:35.634054    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:36.633793 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:36.633760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:36.633988 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:36.633887    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:37.281066 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:37.280425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:37.281066 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:37.280497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:37.281066 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.280595    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:37.281066 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.280652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:45.280637112 +0000 UTC m=+18.089483530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:37.281066 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.280993    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:37.281066 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.281034    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:45.281023453 +0000 UTC m=+18.089869867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:37.381075 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:37.381042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:37.381248 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.381186    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:37.381248 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.381207    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:37.381248 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.381221    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:37.381447 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.381264    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:45.381251586 +0000 UTC m=+18.190098002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:37.637750 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:37.637671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:37.638147 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.637809    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:37.638312 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:37.638286    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:37.638521 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:37.638500    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:38.633437 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:38.633409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:38.633596 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:38.633519    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:39.633764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:39.633736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:39.634195 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:39.633865    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:39.634195 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:39.633953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:39.634195 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:39.634083    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:40.634256 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:40.634226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:40.634666 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:40.634339    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:41.633866 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:41.633618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:41.634010 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:41.633674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:41.634010 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:41.633924    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:41.634010 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:41.633960    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:42.633712 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:42.633681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:42.634171 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:42.633783    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:43.634078 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:43.634039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:43.634492 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:43.634160    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:43.634492 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:43.634197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:43.634492 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:43.634247    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:44.633869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:44.633840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:44.634078 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:44.633949    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:45.345574 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:45.345543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:45.346016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:45.345595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:45.346016 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.345702    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:45.346016 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.345715    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:45.346016 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.345787    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:01.345747599 +0000 UTC m=+34.154594016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:45.346016 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.345810    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:01.345797492 +0000 UTC m=+34.154643908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:45.446324 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:45.446289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:45.446516 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.446448    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:45.446516 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.446469    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:45.446516 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.446478    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:45.446678 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.446527    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:01.446512311 +0000 UTC m=+34.255358724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:45.634142 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:45.634077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:45.634142 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:45.634126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:45.634342 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.634216    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:45.634413 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:45.634333    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:46.633862 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:46.633828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:46.634225 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:46.633968    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:47.634878 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:47.634841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:47.635268 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:47.634940    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:47.635268 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:47.635002    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:47.635268 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:47.635136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:48.633504 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:48.633468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:48.633668 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:48.633579    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:49.636128 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.635481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:49.636128 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:49.635785    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:49.636128 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.635599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:49.636128 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:49.635883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:49.693691 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.693659    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerStarted","Data":"843d28f6ebf5b442bc779e34e1aed4c7233a45b637dc99110a98aa4ddad3447b"}
Jul 09 18:41:49.695996 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.695888    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:41:49.696368 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.696342    2578 generic.go:356] "Generic (PLEG): container finished" podID="48d4d772-ffbd-4222-bf8d-537649eb0379" containerID="b0730b6aabba323604d55bbf2a50a10215c91aed6d7be3319cbe060fe75296c5" exitCode=1
Jul 09 18:41:49.696449 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.696423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"aa4c144be1360f5c895813f489e30bd4a75f5c9971bc9da44c7ef96679a86525"}
Jul 09 18:41:49.696645 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.696524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerDied","Data":"b0730b6aabba323604d55bbf2a50a10215c91aed6d7be3319cbe060fe75296c5"}
Jul 09 18:41:49.696645 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.696585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"d8ea81cdbf5c1ed76be3306230cdd155f322751a9b16cd61ca95bdd7e404626d"}
Jul 09 18:41:49.699031 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.698706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal" event={"ID":"3c268e93e8c7930ec1c5d8f84479e66a","Type":"ContainerStarted","Data":"77d84522f2de2b8ecbcdefeaae8b5d341002b6c5872162a73ddcb01e377744b5"}
Jul 09 18:41:49.701201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.701114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tnbw4" event={"ID":"ff676955-44dc-425e-8060-3baca082807a","Type":"ContainerStarted","Data":"b6c1420b515555d3ed67330996dbf139d3e995b7287314084ee8d905b2250be8"}
Jul 09 18:41:49.703124 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.703103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b28rh" event={"ID":"6d74d83d-a040-4ffd-8610-8e0c4191006f","Type":"ContainerStarted","Data":"47bba34a05aa7b531c979a9cf5393cba2143d170292bdb27b68b22f626adf19f"}
Jul 09 18:41:49.704885 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.704861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb" event={"ID":"4f95b2e4-8515-44d0-98d6-181121eebbb4","Type":"ContainerStarted","Data":"f3f7f95d9af7bfb43c01f3fe44eb067cfc1861578b034024888be2fd4aa4d158"}
Jul 09 18:41:49.706483 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.706430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m87nd" event={"ID":"b5351b00-be0e-4a27-907f-5d3fb9e4c529","Type":"ContainerStarted","Data":"3340be9799a6acd346ad2cc1c9cb2ced09c61e5b79ea4e43e793374923b2979a"}
Jul 09 18:41:49.708093 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.707805    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e71da175edc53f23463ed6dcccdf14e" containerID="b09af8bf45b6196c7548e7d2687822604d6c9de20b27416b9f1a3a9847c21528" exitCode=0
Jul 09 18:41:49.708093 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.707873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal" event={"ID":"6e71da175edc53f23463ed6dcccdf14e","Type":"ContainerDied","Data":"b09af8bf45b6196c7548e7d2687822604d6c9de20b27416b9f1a3a9847c21528"}
Jul 09 18:41:49.709575 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.709556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lv4fg" event={"ID":"8751e110-a548-4539-8e9b-6748fdf7e246","Type":"ContainerStarted","Data":"cac577a02005ff25f69318376945a3173aad362c04787af5553720bfc151996b"}
Jul 09 18:41:49.711271 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.711250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbqlb" event={"ID":"cc95cb71-a45f-4706-9302-bc7a09bcbc73","Type":"ContainerStarted","Data":"fa1d58183a275d2f0d2ab9ffdcc38f91accdd2bfbaf81e4b5c778301b1464e01"}
Jul 09 18:41:49.738403 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.737781    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tnbw4" podStartSLOduration=2.322350614 podStartE2EDuration="21.737765055s" totalImagesPullingTime="19.415414441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:49.737669502 +0000 UTC m=+22.546515937" watchObservedRunningTime="2026-07-09 18:41:49.737765055 +0000 UTC m=+22.546611491"
Jul 09 18:41:49.758717 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.758677    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b28rh" podStartSLOduration=2.331752711 podStartE2EDuration="21.758658601s" totalImagesPullingTime="19.42690589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:49.75825941 +0000 UTC m=+22.567106043" watchObservedRunningTime="2026-07-09 18:41:49.758658601 +0000 UTC m=+22.567505035"
Jul 09 18:41:49.777397 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.777331    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gbqlb" podStartSLOduration=6.106057674 podStartE2EDuration="21.777318444s" totalImagesPullingTime="15.67126077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:49.776930449 +0000 UTC m=+22.585776883" watchObservedRunningTime="2026-07-09 18:41:49.777318444 +0000 UTC m=+22.586164928"
Jul 09 18:41:49.797062 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.797029    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lv4fg" podStartSLOduration=10.381403457 podStartE2EDuration="21.797018515s" totalImagesPullingTime="11.415615058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:49.796264586 +0000 UTC m=+22.605111020" watchObservedRunningTime="2026-07-09 18:41:49.797018515 +0000 UTC m=+22.605864949"
Jul 09 18:41:49.836590 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.836294    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-245.ec2.internal" podStartSLOduration=20.836278394 podStartE2EDuration="20.836278394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:49.835703621 +0000 UTC m=+22.644550056" watchObservedRunningTime="2026-07-09 18:41:49.836278394 +0000 UTC m=+22.645124828"
Jul 09 18:41:49.861558 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:49.861525    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m87nd" podStartSLOduration=2.353227431 podStartE2EDuration="21.8615137s" totalImagesPullingTime="19.508286269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:49.86126117 +0000 UTC m=+22.670107607" watchObservedRunningTime="2026-07-09 18:41:49.8615137 +0000 UTC m=+22.670360135"
Jul 09 18:41:50.633931 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.633909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:50.634051 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:50.634017    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:50.714783 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.714759    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8e88489-f037-4b40-a4c8-e77b72bf5e40" containerID="843d28f6ebf5b442bc779e34e1aed4c7233a45b637dc99110a98aa4ddad3447b" exitCode=0
Jul 09 18:41:50.715442 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.714843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerDied","Data":"843d28f6ebf5b442bc779e34e1aed4c7233a45b637dc99110a98aa4ddad3447b"}
Jul 09 18:41:50.717543 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.717529    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:41:50.717916 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.717896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"a910a58a30c332fc0c769802653d1d867c22f05a3df9501c6303eb0e731987ed"}
Jul 09 18:41:50.717989 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.717957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"079f81d84793a7ef7c6e5564a8b7237468110c49aff1e12f4bdfc429563ed355"}
Jul 09 18:41:50.718039 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.717998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"dce9e23b23d7093127e337f4985f195c513d2c16f5f3ecc6b441ac217d491116"}
Jul 09 18:41:50.719517 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.719501    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal" event={"ID":"6e71da175edc53f23463ed6dcccdf14e","Type":"ContainerStarted","Data":"3729e7aa44cbf6a8184a49e301f26a838b3f63760e0de3163b1e472be140dfcf"}
Jul 09 18:41:50.720933 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.720907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwdxf" event={"ID":"3c97fc31-9524-43c2-8d41-dbbc6b06db3e","Type":"ContainerStarted","Data":"998787c6580063f2e7b9a87ce73ca03e6be4445ec67400ad88a71d58ecbc8c21"}
Jul 09 18:41:50.783343 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.783300    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-245.ec2.internal" podStartSLOduration=21.78328545 podStartE2EDuration="21.78328545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:50.760232434 +0000 UTC m=+23.569078869" watchObservedRunningTime="2026-07-09 18:41:50.78328545 +0000 UTC m=+23.592131862"
Jul 09 18:41:50.783605 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.783574    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xwdxf" podStartSLOduration=11.380398224 podStartE2EDuration="22.783568557s" totalImagesPullingTime="11.403170333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:50.783226766 +0000 UTC m=+23.592073202" watchObservedRunningTime="2026-07-09 18:41:50.783568557 +0000 UTC m=+23.592415020"
Jul 09 18:41:50.875993 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:50.875972    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:41:51.577075 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:51.576983    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:41:50.875988896Z","UUID":"2a9eeb4f-f5e7-4005-9e8e-fa426aa3d665","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:41:51.578829 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:51.578804    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:41:51.579015 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:51.578848    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:41:51.633364 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:51.633338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:51.633525 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:51.633492    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:51.633585 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:51.633528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:51.633628 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:51.633607    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:51.724900 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:51.724866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb" event={"ID":"4f95b2e4-8515-44d0-98d6-181121eebbb4","Type":"ContainerStarted","Data":"52ac8536ad6cd1ae616fd61ffff4586418a6f22d85475b89bd3d5699e77f4158"}
Jul 09 18:41:52.249861 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.249839    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:52.250363 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.250348    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:52.633569 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.633492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:52.633707 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:52.633596    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:52.730464 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.730433    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:41:52.730887 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.730841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"19eb9f199dd4e97d1760e7f226afe20ef8ed762be120712e306ebcf0b8d38a2f"}
Jul 09 18:41:52.733172 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.733139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb" event={"ID":"4f95b2e4-8515-44d0-98d6-181121eebbb4","Type":"ContainerStarted","Data":"5bf834226a5c7e4584d48fe97280d60c69c304218958349cc2e416de36d1f2c2"}
Jul 09 18:41:52.758051 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:52.758004    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znbrb" podStartSLOduration=3.259524771 podStartE2EDuration="24.757991135s" totalImagesPullingTime="21.498466364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:52.757475322 +0000 UTC m=+25.566321759" watchObservedRunningTime="2026-07-09 18:41:52.757991135 +0000 UTC m=+25.566837587"
Jul 09 18:41:53.633494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:53.633468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:53.633665 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:53.633597    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:53.633783 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:53.633678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:53.633843 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:53.633781    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:54.633317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:54.633249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:54.633714 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:54.633359    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:55.157584 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.157406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:55.248993 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.248919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:55.633470 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.633436    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:55.634065 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:55.633546    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:55.634065 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.633610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:55.634065 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:55.633715    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:55.741485 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.741449    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8e88489-f037-4b40-a4c8-e77b72bf5e40" containerID="03e509be0af7d9ca0d90ccae4bf46c3b59502c65623483a44568c8fa5640c589" exitCode=0
Jul 09 18:41:55.741592 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.741539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerDied","Data":"03e509be0af7d9ca0d90ccae4bf46c3b59502c65623483a44568c8fa5640c589"}
Jul 09 18:41:55.745287 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.745269    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:41:55.745648 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.745629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"0561c100d618435418a9734c4c7d4266a7a20210dafbf5389e64f6dbd62a1073"}
Jul 09 18:41:55.745912 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.745891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:55.746016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.745956    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:55.746016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.746007    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:55.746133 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.746031    2578 scope.go:117] "RemoveContainer" containerID="b0730b6aabba323604d55bbf2a50a10215c91aed6d7be3319cbe060fe75296c5"
Jul 09 18:41:55.761944 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.761922    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:55.762033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:55.762020    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:41:56.633442 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:56.633249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:56.633730 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:56.633511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:56.751129 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:56.751105    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:41:56.751704 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:56.751674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" event={"ID":"48d4d772-ffbd-4222-bf8d-537649eb0379","Type":"ContainerStarted","Data":"5442a55184af01ba1fecc55d651ba415c9805cc0cb788be74abf96d576bc9141"}
Jul 09 18:41:56.789165 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:56.789109    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s685n" podStartSLOduration=9.285497567 podStartE2EDuration="28.789084381s" totalImagesPullingTime="19.503586814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:56.78632923 +0000 UTC m=+29.595175646" watchObservedRunningTime="2026-07-09 18:41:56.789084381 +0000 UTC m=+29.597930816"
Jul 09 18:41:57.277684 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.277621    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2kztj"]
Jul 09 18:41:57.277816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.277776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:57.277912 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:57.277890    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:57.280607 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.280580    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m72t8"]
Jul 09 18:41:57.280722 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.280710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:57.280846 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:57.280822    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:57.281309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.281284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kl8gq"]
Jul 09 18:41:57.281412 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.281403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:57.281507 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:57.281487    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:57.477656 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.477625    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:57.477798 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.477727    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:41:57.478281 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.478259    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gbqlb"
Jul 09 18:41:57.553008 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.552949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:41:57.755497 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.755477    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8e88489-f037-4b40-a4c8-e77b72bf5e40" containerID="c0ddb2758d88bcef7a284a5d7bd16d3b52b0f5a74e27083bbad98ed7fdb793a7" exitCode=0
Jul 09 18:41:57.755773 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:57.755506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerDied","Data":"c0ddb2758d88bcef7a284a5d7bd16d3b52b0f5a74e27083bbad98ed7fdb793a7"}
Jul 09 18:41:58.633419 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:58.633371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:41:58.633562 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:58.633514    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:41:58.633613 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:58.633596    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:41:58.633715 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:58.633697    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:41:59.633980 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:59.633950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:41:59.634406 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:41:59.634047    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:41:59.761883 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:59.761852    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8e88489-f037-4b40-a4c8-e77b72bf5e40" containerID="e75048929cc1f1a5f99dcbce3c538992ecf009b9dffa46e0c69a07d78fa27db0" exitCode=0
Jul 09 18:41:59.761968 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:41:59.761920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerDied","Data":"e75048929cc1f1a5f99dcbce3c538992ecf009b9dffa46e0c69a07d78fa27db0"}
Jul 09 18:42:00.194280 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:00.194245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:00.293665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:00.293641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:00.633874 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:00.633803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:00.634021 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:00.633910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:42:00.634021 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:00.633995    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m72t8" podUID="e9123ce4-5241-47ce-a907-4c44d9e87605"
Jul 09 18:42:00.634021 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:00.634002    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kl8gq" podUID="d2232a04-6252-410d-a9e3-0e2da0ac5a95"
Jul 09 18:42:01.369105 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:01.369072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:42:01.369397 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:01.369126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:42:01.369397 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.369216    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:42:01.369397 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.369222    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:42:01.369397 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.369270    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs podName:e9123ce4-5241-47ce-a907-4c44d9e87605 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:33.369251798 +0000 UTC m=+66.178098210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs") pod "network-metrics-daemon-m72t8" (UID: "e9123ce4-5241-47ce-a907-4c44d9e87605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:42:01.369397 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.369288    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret podName:809f082e-d099-4758-b605-f4d76eedd980 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:33.36927934 +0000 UTC m=+66.178125755 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret") pod "global-pull-secret-syncer-2kztj" (UID: "809f082e-d099-4758-b605-f4d76eedd980") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:42:01.470166 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:01.470143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:01.470289 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.470252    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:42:01.470289 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.470267    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:42:01.470289 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.470275    2578 projected.go:196] Error preparing data for projected volume kube-api-access-vf65d for pod openshift-network-diagnostics/network-check-target-kl8gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:42:01.470405 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.470320    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d podName:d2232a04-6252-410d-a9e3-0e2da0ac5a95 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:33.470303547 +0000 UTC m=+66.279149981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf65d" (UniqueName: "kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d") pod "network-check-target-kl8gq" (UID: "d2232a04-6252-410d-a9e3-0e2da0ac5a95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:42:01.633711 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:01.633646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:42:01.633847 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:01.633767    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2kztj" podUID="809f082e-d099-4758-b605-f4d76eedd980"
Jul 09 18:42:02.065136 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.065114    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-245.ec2.internal" event="NodeReady"
Jul 09 18:42:02.065561 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.065235    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:42:02.114015 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.113987    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9nl2t"]
Jul 09 18:42:02.120877 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.120854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.123149 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.123127    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8rc8w"]
Jul 09 18:42:02.124565 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.124530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm22z\""
Jul 09 18:42:02.124685 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.124662    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:42:02.124748 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.124535    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:42:02.127392 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.127343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.128804 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.128785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9nl2t"]
Jul 09 18:42:02.131453 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.131437    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:42:02.131567 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.131497    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9cbfv\""
Jul 09 18:42:02.131819 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.131801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:42:02.131910 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.131850    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:42:02.136771 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.136749    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8rc8w"]
Jul 09 18:42:02.177353 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.177327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e5163a-39af-4af8-a583-c09d52cfe568-tmp-dir\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.177472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.177356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msbqw\" (UniqueName: \"kubernetes.io/projected/76444cae-583d-4ea3-a256-1f7e025a1397-kube-api-access-msbqw\") pod \"ingress-canary-8rc8w\" (UID: \"76444cae-583d-4ea3-a256-1f7e025a1397\") " pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.177472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.177397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e5163a-39af-4af8-a583-c09d52cfe568-config-volume\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.177472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.177436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.177472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.177458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspcw\" (UniqueName: \"kubernetes.io/projected/b9e5163a-39af-4af8-a583-c09d52cfe568-kube-api-access-hspcw\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.177689 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.177482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76444cae-583d-4ea3-a256-1f7e025a1397-cert\") pod \"ingress-canary-8rc8w\" (UID: \"76444cae-583d-4ea3-a256-1f7e025a1397\") " pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.278739 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.278710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e5163a-39af-4af8-a583-c09d52cfe568-tmp-dir\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.278856 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.278746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msbqw\" (UniqueName: \"kubernetes.io/projected/76444cae-583d-4ea3-a256-1f7e025a1397-kube-api-access-msbqw\") pod \"ingress-canary-8rc8w\" (UID: \"76444cae-583d-4ea3-a256-1f7e025a1397\") " pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.278856 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.278766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e5163a-39af-4af8-a583-c09d52cfe568-config-volume\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.278961 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.278855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.278961 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.278895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspcw\" (UniqueName: \"kubernetes.io/projected/b9e5163a-39af-4af8-a583-c09d52cfe568-kube-api-access-hspcw\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.278961 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.278936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76444cae-583d-4ea3-a256-1f7e025a1397-cert\") pod \"ingress-canary-8rc8w\" (UID: \"76444cae-583d-4ea3-a256-1f7e025a1397\") " pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.279102 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:02.278959    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:02.279102 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:02.279042    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls podName:b9e5163a-39af-4af8-a583-c09d52cfe568 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:02.779012292 +0000 UTC m=+35.587858712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls") pod "dns-default-9nl2t" (UID: "b9e5163a-39af-4af8-a583-c09d52cfe568") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:02.279318 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.279297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e5163a-39af-4af8-a583-c09d52cfe568-tmp-dir\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.279373 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.279355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9e5163a-39af-4af8-a583-c09d52cfe568-config-volume\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.283555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.283534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76444cae-583d-4ea3-a256-1f7e025a1397-cert\") pod \"ingress-canary-8rc8w\" (UID: \"76444cae-583d-4ea3-a256-1f7e025a1397\") " pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.290941 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.290919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msbqw\" (UniqueName: \"kubernetes.io/projected/76444cae-583d-4ea3-a256-1f7e025a1397-kube-api-access-msbqw\") pod \"ingress-canary-8rc8w\" (UID: \"76444cae-583d-4ea3-a256-1f7e025a1397\") " pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.292576 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.292530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspcw\" (UniqueName: \"kubernetes.io/projected/b9e5163a-39af-4af8-a583-c09d52cfe568-kube-api-access-hspcw\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.308776 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.308752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:02.382453 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.382300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:02.441339 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.441311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8rc8w"
Jul 09 18:42:02.591104 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.591069    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8rc8w"]
Jul 09 18:42:02.634348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.634282    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:02.634566 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.634542    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:42:02.638144 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.638121    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:42:02.638253 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.638151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:42:02.639889 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.639870    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ppzx8\""
Jul 09 18:42:02.640061 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.640048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cz2v8\""
Jul 09 18:42:02.640201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.640191    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:42:02.783145 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:02.782947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:02.783280 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:02.783102    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:02.783280 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:02.783231    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls podName:b9e5163a-39af-4af8-a583-c09d52cfe568 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:03.783211169 +0000 UTC m=+36.592057587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls") pod "dns-default-9nl2t" (UID: "b9e5163a-39af-4af8-a583-c09d52cfe568") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:03.563491 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:03.563427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:03.633915 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:03.633885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:42:03.637629 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:03.637610    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:42:03.645799 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:03.645761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:03.791192 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:03.791159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:03.791364 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:03.791266    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:03.791364 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:03.791350    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls podName:b9e5163a-39af-4af8-a583-c09d52cfe568 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:05.791329518 +0000 UTC m=+38.600175948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls") pod "dns-default-9nl2t" (UID: "b9e5163a-39af-4af8-a583-c09d52cfe568") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:04.022147 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:04.022116    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76444cae_583d_4ea3_a256_1f7e025a1397.slice/crio-8b644081629024eb2e27f25bc44eb68973e06ed8d13dcbffa4b1363bdbcd5bfe WatchSource:0}: Error finding container 8b644081629024eb2e27f25bc44eb68973e06ed8d13dcbffa4b1363bdbcd5bfe: Status 404 returned error can't find the container with id 8b644081629024eb2e27f25bc44eb68973e06ed8d13dcbffa4b1363bdbcd5bfe
Jul 09 18:42:04.775151 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:04.775117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8rc8w" event={"ID":"76444cae-583d-4ea3-a256-1f7e025a1397","Type":"ContainerStarted","Data":"8b644081629024eb2e27f25bc44eb68973e06ed8d13dcbffa4b1363bdbcd5bfe"}
Jul 09 18:42:04.778348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:04.778321    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8e88489-f037-4b40-a4c8-e77b72bf5e40" containerID="3e3d0fb650d072e91a16413f66af3bf258d5c1fb737d2bd2993db1603972cf6e" exitCode=0
Jul 09 18:42:04.778505 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:04.778358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerDied","Data":"3e3d0fb650d072e91a16413f66af3bf258d5c1fb737d2bd2993db1603972cf6e"}
Jul 09 18:42:05.783553 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:05.783515    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8e88489-f037-4b40-a4c8-e77b72bf5e40" containerID="507bdc1f3dfd46cf0f4e058b505e85687feb0d7cbcb485a11a714efd314b7447" exitCode=0
Jul 09 18:42:05.784000 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:05.783554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerDied","Data":"507bdc1f3dfd46cf0f4e058b505e85687feb0d7cbcb485a11a714efd314b7447"}
Jul 09 18:42:05.804932 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:05.804910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:05.805080 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:05.805062    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:05.805146 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:05.805134    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls podName:b9e5163a-39af-4af8-a583-c09d52cfe568 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:09.805112467 +0000 UTC m=+42.613958879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls") pod "dns-default-9nl2t" (UID: "b9e5163a-39af-4af8-a583-c09d52cfe568") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:06.470025 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:06.469978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:06.788560 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:06.788492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclz" event={"ID":"e8e88489-f037-4b40-a4c8-e77b72bf5e40","Type":"ContainerStarted","Data":"2e849a63d3152d69178f0abf063de63d0846016691a7a594682c3b6311897b79"}
Jul 09 18:42:06.828858 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:06.828810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ghclz" podStartSLOduration=12.257270568 podStartE2EDuration="38.828791455s" totalImagesPullingTime="26.571520887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:06.828163516 +0000 UTC m=+39.637009951" watchObservedRunningTime="2026-07-09 18:42:06.828791455 +0000 UTC m=+39.637637889"
Jul 09 18:42:06.966096 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:06.966075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:07.068072 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:07.068019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:07.267906 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:07.267880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:07.368770 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:07.368681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:07.792007 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:07.791967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8rc8w" event={"ID":"76444cae-583d-4ea3-a256-1f7e025a1397","Type":"ContainerStarted","Data":"51ae43c842530174a8fb5a72eb84711f5f0670304ad18bfb3275aaa338b7ac55"}
Jul 09 18:42:07.816471 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:07.816428    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8rc8w" podStartSLOduration=2.703622822 podStartE2EDuration="5.816415212s" totalImagesPullingTime="3.11279239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:07.815506117 +0000 UTC m=+40.624352552" watchObservedRunningTime="2026-07-09 18:42:07.816415212 +0000 UTC m=+40.625261648"
Jul 09 18:42:09.833537 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:09.833505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:09.833916 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:09.833644    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:09.833916 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:09.833717    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls podName:b9e5163a-39af-4af8-a583-c09d52cfe568 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:17.833701673 +0000 UTC m=+50.642548086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls") pod "dns-default-9nl2t" (UID: "b9e5163a-39af-4af8-a583-c09d52cfe568") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:10.792710 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.792679    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"]
Jul 09 18:42:10.831900 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.831876    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-wk2mx"]
Jul 09 18:42:10.832073 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.832027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"
Jul 09 18:42:10.851638 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.851616    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cf5db78cd-wfx7n"]
Jul 09 18:42:10.851935 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.851733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:10.854794 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.854776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fdfml\""
Jul 09 18:42:10.854922 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.854899    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:42:10.855009 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.854910    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 18:42:10.869776 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.869750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 18:42:10.873881 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.873858    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"]
Jul 09 18:42:10.873986 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.873904    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-wk2mx"]
Jul 09 18:42:10.873986 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.873925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cf5db78cd-wfx7n"]
Jul 09 18:42:10.874083 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.874013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:10.876884 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.876860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 18:42:10.877251 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.877228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m428n\""
Jul 09 18:42:10.882655 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.882639    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 18:42:10.884682 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.884666    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:42:10.890154 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890138    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 18:42:10.890555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890535    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 18:42:10.890641 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 18:42:10.890704 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890683    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 18:42:10.890805 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 18:42:10.890854 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890826    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 18:42:10.890893 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.890869    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-crttp\""
Jul 09 18:42:10.919840 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.919817    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 18:42:10.937388 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.937363    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-qwdbq"]
Jul 09 18:42:10.941080 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:10.941140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b06cb015-480d-4404-8465-34535cd2e097-serving-cert\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:10.941140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-stats-auth\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:10.941226 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-default-certificate\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:10.941226 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldjs\" (UniqueName: \"kubernetes.io/projected/15738328-8650-4356-80f3-199f27ad3c9e-kube-api-access-gldjs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:10.941309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frslj\" (UniqueName: \"kubernetes.io/projected/a18d879f-c50e-4e3d-a0ba-f14a8e129dfa-kube-api-access-frslj\") pod \"volume-data-source-validator-78495597f6-2s96p\" (UID: \"a18d879f-c50e-4e3d-a0ba-f14a8e129dfa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"
Jul 09 18:42:10.941309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b06cb015-480d-4404-8465-34535cd2e097-trusted-ca\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:10.941309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:10.941429 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b06cb015-480d-4404-8465-34535cd2e097-config\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:10.941429 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.941333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxxs\" (UniqueName: \"kubernetes.io/projected/b06cb015-480d-4404-8465-34535cd2e097-kube-api-access-cvxxs\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:10.959756 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.959736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-qwdbq"]
Jul 09 18:42:10.959837 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.959816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:10.962953 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.962937    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 18:42:10.963038 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.962988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8lbpr\""
Jul 09 18:42:10.963484 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.963468    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 18:42:10.963563 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.963483    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 18:42:10.963563 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.963557    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 18:42:10.969278 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:10.969260    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 18:42:11.042331 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a760bd-aa99-493a-b090-663f814d45da-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.042437 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-725fq\" (UniqueName: \"kubernetes.io/projected/a4a760bd-aa99-493a-b090-663f814d45da-kube-api-access-725fq\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.042437 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-default-certificate\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.042437 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a4a760bd-aa99-493a-b090-663f814d45da-snapshots\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.042437 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gldjs\" (UniqueName: \"kubernetes.io/projected/15738328-8650-4356-80f3-199f27ad3c9e-kube-api-access-gldjs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frslj\" (UniqueName: \"kubernetes.io/projected/a18d879f-c50e-4e3d-a0ba-f14a8e129dfa-kube-api-access-frslj\") pod \"volume-data-source-validator-78495597f6-2s96p\" (UID: \"a18d879f-c50e-4e3d-a0ba-f14a8e129dfa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b06cb015-480d-4404-8465-34535cd2e097-trusted-ca\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4a760bd-aa99-493a-b090-663f814d45da-tmp\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b06cb015-480d-4404-8465-34535cd2e097-config\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxxs\" (UniqueName: \"kubernetes.io/projected/b06cb015-480d-4404-8465-34535cd2e097-kube-api-access-cvxxs\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a760bd-aa99-493a-b090-663f814d45da-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a760bd-aa99-493a-b090-663f814d45da-serving-cert\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:11.042634    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.042706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b06cb015-480d-4404-8465-34535cd2e097-serving-cert\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.043333 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:11.042716    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:11.542696286 +0000 UTC m=+44.351542719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : secret "router-metrics-certs-default" not found
Jul 09 18:42:11.043333 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:11.042824    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:11.542806518 +0000 UTC m=+44.351652941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : configmap references non-existent config key: service-ca.crt
Jul 09 18:42:11.043333 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.042892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-stats-auth\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.043517 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.043342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b06cb015-480d-4404-8465-34535cd2e097-config\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.043570 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.043525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b06cb015-480d-4404-8465-34535cd2e097-trusted-ca\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.046443 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.046411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b06cb015-480d-4404-8465-34535cd2e097-serving-cert\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.046539 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.046481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-default-certificate\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.046589 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.046537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-stats-auth\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.054285 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.054263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxxs\" (UniqueName: \"kubernetes.io/projected/b06cb015-480d-4404-8465-34535cd2e097-kube-api-access-cvxxs\") pod \"console-operator-7866497494-wk2mx\" (UID: \"b06cb015-480d-4404-8465-34535cd2e097\") " pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.055503 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.055480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frslj\" (UniqueName: \"kubernetes.io/projected/a18d879f-c50e-4e3d-a0ba-f14a8e129dfa-kube-api-access-frslj\") pod \"volume-data-source-validator-78495597f6-2s96p\" (UID: \"a18d879f-c50e-4e3d-a0ba-f14a8e129dfa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"
Jul 09 18:42:11.056522 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.056505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldjs\" (UniqueName: \"kubernetes.io/projected/15738328-8650-4356-80f3-199f27ad3c9e-kube-api-access-gldjs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.079511 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.079482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:11.141511 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.141492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"
Jul 09 18:42:11.143787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.143770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4a760bd-aa99-493a-b090-663f814d45da-tmp\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.143871 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.143851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a760bd-aa99-493a-b090-663f814d45da-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.143929 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.143888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a760bd-aa99-493a-b090-663f814d45da-serving-cert\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144006 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.143994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a760bd-aa99-493a-b090-663f814d45da-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144061 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.144022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-725fq\" (UniqueName: \"kubernetes.io/projected/a4a760bd-aa99-493a-b090-663f814d45da-kube-api-access-725fq\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144061 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.144054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a4a760bd-aa99-493a-b090-663f814d45da-snapshots\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144163 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.144025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4a760bd-aa99-493a-b090-663f814d45da-tmp\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144444 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.144423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a760bd-aa99-493a-b090-663f814d45da-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144521 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.144507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a4a760bd-aa99-493a-b090-663f814d45da-snapshots\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.144618 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.144602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4a760bd-aa99-493a-b090-663f814d45da-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.146094 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.146075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a760bd-aa99-493a-b090-663f814d45da-serving-cert\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.154712 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.154696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-725fq\" (UniqueName: \"kubernetes.io/projected/a4a760bd-aa99-493a-b090-663f814d45da-kube-api-access-725fq\") pod \"insights-operator-68d9dd94cf-qwdbq\" (UID: \"a4a760bd-aa99-493a-b090-663f814d45da\") " pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.162532 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.162508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:11.188079 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.188055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:11.267986 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.267962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq"
Jul 09 18:42:11.290960 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.290653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:11.305262 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.305212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p"]
Jul 09 18:42:11.307473 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:11.307446    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18d879f_c50e_4e3d_a0ba_f14a8e129dfa.slice/crio-06600aa38a821e1c31b95a79c4056ea20237f7f0fdb4f62749999188d8b6525a WatchSource:0}: Error finding container 06600aa38a821e1c31b95a79c4056ea20237f7f0fdb4f62749999188d8b6525a: Status 404 returned error can't find the container with id 06600aa38a821e1c31b95a79c4056ea20237f7f0fdb4f62749999188d8b6525a
Jul 09 18:42:11.327203 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.327181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-wk2mx"]
Jul 09 18:42:11.330610 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:11.330587    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06cb015_480d_4404_8465_34535cd2e097.slice/crio-3cd02234c1095fea1ab8cfe216b209ac57adef0ae020420729e949ca4d8ffeb4 WatchSource:0}: Error finding container 3cd02234c1095fea1ab8cfe216b209ac57adef0ae020420729e949ca4d8ffeb4: Status 404 returned error can't find the container with id 3cd02234c1095fea1ab8cfe216b209ac57adef0ae020420729e949ca4d8ffeb4
Jul 09 18:42:11.402260 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.402234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:11.420882 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.420774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-qwdbq"]
Jul 09 18:42:11.423213 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:11.423191    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a760bd_aa99_493a_b090_663f814d45da.slice/crio-daf6321fced06619b947a675a8231e093a930b853e5c696ef2a0fb7b757c0e70 WatchSource:0}: Error finding container daf6321fced06619b947a675a8231e093a930b853e5c696ef2a0fb7b757c0e70: Status 404 returned error can't find the container with id daf6321fced06619b947a675a8231e093a930b853e5c696ef2a0fb7b757c0e70
Jul 09 18:42:11.489023 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.488997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:11.548204 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.548148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.548286 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.548191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:11.548347 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:11.548306    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:42:11.548347 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:11.548335    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:12.548317321 +0000 UTC m=+45.357163738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : configmap references non-existent config key: service-ca.crt
Jul 09 18:42:11.548502 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:11.548356    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:12.548343771 +0000 UTC m=+45.357190185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : secret "router-metrics-certs-default" not found
Jul 09 18:42:11.556547 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.556520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:11.801809 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.801742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wk2mx" event={"ID":"b06cb015-480d-4404-8465-34535cd2e097","Type":"ContainerStarted","Data":"3cd02234c1095fea1ab8cfe216b209ac57adef0ae020420729e949ca4d8ffeb4"}
Jul 09 18:42:11.803067 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.803029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq" event={"ID":"a4a760bd-aa99-493a-b090-663f814d45da","Type":"ContainerStarted","Data":"daf6321fced06619b947a675a8231e093a930b853e5c696ef2a0fb7b757c0e70"}
Jul 09 18:42:11.804184 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:11.804164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p" event={"ID":"a18d879f-c50e-4e3d-a0ba-f14a8e129dfa","Type":"ContainerStarted","Data":"06600aa38a821e1c31b95a79c4056ea20237f7f0fdb4f62749999188d8b6525a"}
Jul 09 18:42:12.555436 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:12.555397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:12.555997 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:12.555471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:12.555997 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:12.555488    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:42:12.555997 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:12.555553    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:14.555533654 +0000 UTC m=+47.364380073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : secret "router-metrics-certs-default" not found
Jul 09 18:42:12.555997 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:12.555656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:14.555635483 +0000 UTC m=+47.364481906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : configmap references non-existent config key: service-ca.crt
Jul 09 18:42:14.570749 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:14.570708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:14.570749 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:14.570756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:14.571159 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:14.570852    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:42:14.571159 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:14.570869    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:18.570855738 +0000 UTC m=+51.379702151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : configmap references non-existent config key: service-ca.crt
Jul 09 18:42:14.571159 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:14.570919    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:18.570903397 +0000 UTC m=+51.379749810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : secret "router-metrics-certs-default" not found
Jul 09 18:42:15.710420 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.710371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:15.815519 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.815481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq" event={"ID":"a4a760bd-aa99-493a-b090-663f814d45da","Type":"ContainerStarted","Data":"d07d858f04bb4e0dbd0d06d52c9ddda000f165940cc6cabadccbfe6ca40d7493"}
Jul 09 18:42:15.817127 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.817095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p" event={"ID":"a18d879f-c50e-4e3d-a0ba-f14a8e129dfa","Type":"ContainerStarted","Data":"13423f26029af588e56d8402e849ee47fb9858bfc2dd52a527da91f0dcb925dc"}
Jul 09 18:42:15.818691 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.818668    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/0.log"
Jul 09 18:42:15.818815 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.818711    2578 generic.go:356] "Generic (PLEG): container finished" podID="b06cb015-480d-4404-8465-34535cd2e097" containerID="7ea0a47e669e3d8465f2f9e0ec8cf93e6cdaacfbfb6461939b263771db2dcea6" exitCode=255
Jul 09 18:42:15.818815 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.818741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wk2mx" event={"ID":"b06cb015-480d-4404-8465-34535cd2e097","Type":"ContainerDied","Data":"7ea0a47e669e3d8465f2f9e0ec8cf93e6cdaacfbfb6461939b263771db2dcea6"}
Jul 09 18:42:15.818956 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.818942    2578 scope.go:117] "RemoveContainer" containerID="7ea0a47e669e3d8465f2f9e0ec8cf93e6cdaacfbfb6461939b263771db2dcea6"
Jul 09 18:42:15.838307 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.838269    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq" podStartSLOduration=2.407089035 podStartE2EDuration="5.838257058s" totalImagesPullingTime="3.431168023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:15.837743238 +0000 UTC m=+48.646589673" watchObservedRunningTime="2026-07-09 18:42:15.838257058 +0000 UTC m=+48.647103492"
Jul 09 18:42:15.865167 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.864508    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2s96p" podStartSLOduration=2.323405257 podStartE2EDuration="5.86448945s" totalImagesPullingTime="3.541084193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:15.863452018 +0000 UTC m=+48.672298453" watchObservedRunningTime="2026-07-09 18:42:15.86448945 +0000 UTC m=+48.673335888"
Jul 09 18:42:15.960848 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.960763    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8745v"]
Jul 09 18:42:15.985033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.985007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8745v"]
Jul 09 18:42:15.985158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.985140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:15.988512 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.988491    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 18:42:15.988780 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.988756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:15.989311 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.989294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 18:42:15.989426 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:15.989363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2rdm\""
Jul 09 18:42:16.069858 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.069834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:16.082846 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.082823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7cv\" (UniqueName: \"kubernetes.io/projected/6eacc620-d573-4101-aa52-c8a9937f88de-kube-api-access-hr7cv\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.082918 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.082849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6eacc620-d573-4101-aa52-c8a9937f88de-crio-socket\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.082918 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.082865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eacc620-d573-4101-aa52-c8a9937f88de-data-volume\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.082918 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.082888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.083012 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.082949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.153148 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.153125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:16.184263 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7cv\" (UniqueName: \"kubernetes.io/projected/6eacc620-d573-4101-aa52-c8a9937f88de-kube-api-access-hr7cv\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.184353 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6eacc620-d573-4101-aa52-c8a9937f88de-crio-socket\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.184353 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eacc620-d573-4101-aa52-c8a9937f88de-data-volume\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.184494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.184494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.184494 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.184460    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.184494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184474    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6eacc620-d573-4101-aa52-c8a9937f88de-crio-socket\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.184648 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.184518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:16.684500233 +0000 UTC m=+49.493346656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.184648 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.184566    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.184648 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.184633    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:16.68462088 +0000 UTC m=+49.493467293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.184753 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.184651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eacc620-d573-4101-aa52-c8a9937f88de-data-volume\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.201136 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.201112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7cv\" (UniqueName: \"kubernetes.io/projected/6eacc620-d573-4101-aa52-c8a9937f88de-kube-api-access-hr7cv\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.233558 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.233501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:16.414944 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.414917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:16.517359 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.517295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:16.687965 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.687937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.688049 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.688040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:16.688089 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.688078    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.688119 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.688091    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.688154 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.688139    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:17.688124102 +0000 UTC m=+50.496970515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.688194 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.688159    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:17.688147192 +0000 UTC m=+50.496993605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.823854 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.823805    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:42:16.824279 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.824265    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/0.log"
Jul 09 18:42:16.824329 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.824299    2578 generic.go:356] "Generic (PLEG): container finished" podID="b06cb015-480d-4404-8465-34535cd2e097" containerID="ae0d45400a7427a610f5d8ad0ff2e32ead667138d35a448db7ad19c966d86651" exitCode=255
Jul 09 18:42:16.824429 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.824405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wk2mx" event={"ID":"b06cb015-480d-4404-8465-34535cd2e097","Type":"ContainerDied","Data":"ae0d45400a7427a610f5d8ad0ff2e32ead667138d35a448db7ad19c966d86651"}
Jul 09 18:42:16.824484 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.824469    2578 scope.go:117] "RemoveContainer" containerID="7ea0a47e669e3d8465f2f9e0ec8cf93e6cdaacfbfb6461939b263771db2dcea6"
Jul 09 18:42:16.824741 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:16.824706    2578 scope.go:117] "RemoveContainer" containerID="ae0d45400a7427a610f5d8ad0ff2e32ead667138d35a448db7ad19c966d86651"
Jul 09 18:42:16.824941 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:16.824917    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wk2mx_openshift-console-operator(b06cb015-480d-4404-8465-34535cd2e097)\"" pod="openshift-console-operator/console-operator-7866497494-wk2mx" podUID="b06cb015-480d-4404-8465-34535cd2e097"
Jul 09 18:42:17.695970 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:17.695933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:17.696103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:17.695979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:17.696103 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.696039    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:17.696103 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.696087    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:17.696103 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.696102    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:19.696088251 +0000 UTC m=+52.504934663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:17.696258 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.696137    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:19.696125522 +0000 UTC m=+52.504971936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:17.828774 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:17.828754    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:42:17.829088 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:17.829063    2578 scope.go:117] "RemoveContainer" containerID="ae0d45400a7427a610f5d8ad0ff2e32ead667138d35a448db7ad19c966d86651"
Jul 09 18:42:17.829225 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.829204    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wk2mx_openshift-console-operator(b06cb015-480d-4404-8465-34535cd2e097)\"" pod="openshift-console-operator/console-operator-7866497494-wk2mx" podUID="b06cb015-480d-4404-8465-34535cd2e097"
Jul 09 18:42:17.898524 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:17.898502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:17.898658 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.898646    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:17.898720 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:17.898703    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls podName:b9e5163a-39af-4af8-a583-c09d52cfe568 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:33.898687037 +0000 UTC m=+66.707533450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls") pod "dns-default-9nl2t" (UID: "b9e5163a-39af-4af8-a583-c09d52cfe568") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:17.930555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:17.930507    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tnbw4_ff676955-44dc-425e-8060-3baca082807a/dns-node-resolver/0.log"
Jul 09 18:42:18.106328 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.106276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:18.206212 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.206187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:18.576290 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.576267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:18.604471 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.604449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:18.604548 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.604523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:18.604587 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:18.604566    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 18:42:18.604619 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:18.604613    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:26.604599163 +0000 UTC m=+59.413445575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : secret "router-metrics-certs-default" not found
Jul 09 18:42:18.604658 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:18.604628    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle podName:15738328-8650-4356-80f3-199f27ad3c9e nodeName:}" failed. No retries permitted until 2026-07-09 18:42:26.604617854 +0000 UTC m=+59.413464266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle") pod "router-default-7cf5db78cd-wfx7n" (UID: "15738328-8650-4356-80f3-199f27ad3c9e") : configmap references non-existent config key: service-ca.crt
Jul 09 18:42:18.670968 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.670939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:18.728720 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.728694    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lv4fg_8751e110-a548-4539-8e9b-6748fdf7e246/node-ca/0.log"
Jul 09 18:42:18.938719 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:18.938690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:19.529044 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:19.529019    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8rc8w_76444cae-583d-4ea3-a256-1f7e025a1397/serve-healthcheck-canary/0.log"
Jul 09 18:42:19.712090 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:19.712065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:19.712307 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:19.712100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:19.712307 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:19.712197    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:19.712307 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:19.712256    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:19.712307 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:19.712263    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:23.712245389 +0000 UTC m=+56.521091805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:19.712307 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:19.712300    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:23.712288344 +0000 UTC m=+56.521134757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:19.932791 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:19.932746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:20.086987 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:20.086959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:20.202454 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:20.202365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:20.302393 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:20.302354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:20.404751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:20.404727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:20.503263 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:20.503212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:20.623631 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:20.623606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:21.028959 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:21.028909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:21.163431 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:21.163399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:21.163792 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:21.163457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:21.163792 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:21.163777    2578 scope.go:117] "RemoveContainer" containerID="ae0d45400a7427a610f5d8ad0ff2e32ead667138d35a448db7ad19c966d86651"
Jul 09 18:42:21.163927 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:21.163908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wk2mx_openshift-console-operator(b06cb015-480d-4404-8465-34535cd2e097)\"" pod="openshift-console-operator/console-operator-7866497494-wk2mx" podUID="b06cb015-480d-4404-8465-34535cd2e097"
Jul 09 18:42:21.826433 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:21.826401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:22.030035 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:22.029988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:22.099116 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:22.099020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:22.672925 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:22.672872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:23.034934 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.034842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:23.426677 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.426632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:23.627299 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.627270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:23.744303 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.744240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:23.744303 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.744275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:23.744724 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:23.744365    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:23.744724 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:23.744402    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:23.744724 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:23.744446    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:31.744429882 +0000 UTC m=+64.553276295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:23.744724 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:23.744534    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls podName:6eacc620-d573-4101-aa52-c8a9937f88de nodeName:}" failed. No retries permitted until 2026-07-09 18:42:31.744508388 +0000 UTC m=+64.553354801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8745v" (UID: "6eacc620-d573-4101-aa52-c8a9937f88de") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:23.811231 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.811201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:23.877678 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:23.877647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:24.227206 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:24.227178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:24.442701 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:24.442673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:24.565910 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:24.565844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:25.023014 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:25.022981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:25.280400 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:25.280321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:25.425288 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:25.425255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:25.627656 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:25.627595    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:25.847199 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:25.847166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:26.125234 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.125199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:26.668101 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.668070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:26.668254 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.668128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:26.668779 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.668751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15738328-8650-4356-80f3-199f27ad3c9e-service-ca-bundle\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:26.670727 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.670704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15738328-8650-4356-80f3-199f27ad3c9e-metrics-certs\") pod \"router-default-7cf5db78cd-wfx7n\" (UID: \"15738328-8650-4356-80f3-199f27ad3c9e\") " pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:26.784343 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.784318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:26.911901 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:26.911876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cf5db78cd-wfx7n"]
Jul 09 18:42:26.915266 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:26.915243    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15738328_8650_4356_80f3_199f27ad3c9e.slice/crio-fdf15a409e1f6742be943dd521335a6e92bb7a922bfe8847b52f2dabbcd7dcbe WatchSource:0}: Error finding container fdf15a409e1f6742be943dd521335a6e92bb7a922bfe8847b52f2dabbcd7dcbe: Status 404 returned error can't find the container with id fdf15a409e1f6742be943dd521335a6e92bb7a922bfe8847b52f2dabbcd7dcbe
Jul 09 18:42:27.032175 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.032137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:27.225141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.225116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:27.426767 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.426730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:27.627356 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.627288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:27.774344 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.774319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s685n"
Jul 09 18:42:27.843797 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.843766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:27.855216 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.855193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n" event={"ID":"15738328-8650-4356-80f3-199f27ad3c9e","Type":"ContainerStarted","Data":"98546af251cac359b837565b49abb56ebc3bc536e7cb62f7990389fbf0349b4e"}
Jul 09 18:42:27.855283 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.855228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n" event={"ID":"15738328-8650-4356-80f3-199f27ad3c9e","Type":"ContainerStarted","Data":"fdf15a409e1f6742be943dd521335a6e92bb7a922bfe8847b52f2dabbcd7dcbe"}
Jul 09 18:42:27.881119 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:27.881053    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n" podStartSLOduration=17.88104091 podStartE2EDuration="17.88104091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:27.880880116 +0000 UTC m=+60.689726551" watchObservedRunningTime="2026-07-09 18:42:27.88104091 +0000 UTC m=+60.689887345"
Jul 09 18:42:28.630513 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:28.630473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:28.785371 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:28.785339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:28.788218 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:28.788194    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:28.830114 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:28.830084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:28.857665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:28.857644    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:28.858815 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:28.858799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cf5db78cd-wfx7n"
Jul 09 18:42:29.025457 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:29.025430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:29.162148 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:29.162122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:29.266320 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:29.266292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:29.430822 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:29.430800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:29.825087 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:29.825020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:30.223186 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:30.223156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:30.427386 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:30.427358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:30.626238 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:30.626166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:31.038141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.038112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:31.802792 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.802769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:31.802922 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.802860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:31.803337 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.803317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6eacc620-d573-4101-aa52-c8a9937f88de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:31.805311 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.805278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6eacc620-d573-4101-aa52-c8a9937f88de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8745v\" (UID: \"6eacc620-d573-4101-aa52-c8a9937f88de\") " pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:31.897552 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.897528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2rdm\""
Jul 09 18:42:31.904276 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:31.904254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8745v"
Jul 09 18:42:32.030847 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:32.030822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8745v"]
Jul 09 18:42:32.033669 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:32.033637    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eacc620_d573_4101_aa52_c8a9937f88de.slice/crio-72340ec5809d1327d30dbffccbc85b50a3a49c130eda675052704d72198d25f8 WatchSource:0}: Error finding container 72340ec5809d1327d30dbffccbc85b50a3a49c130eda675052704d72198d25f8: Status 404 returned error can't find the container with id 72340ec5809d1327d30dbffccbc85b50a3a49c130eda675052704d72198d25f8
Jul 09 18:42:32.874062 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:32.874020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8745v" event={"ID":"6eacc620-d573-4101-aa52-c8a9937f88de","Type":"ContainerStarted","Data":"72340ec5809d1327d30dbffccbc85b50a3a49c130eda675052704d72198d25f8"}
Jul 09 18:42:33.414522 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.414487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:42:33.414697 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.414541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:42:33.418095 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.418068    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:42:33.418204 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.418068    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:42:33.427397 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.427366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/809f082e-d099-4758-b605-f4d76eedd980-original-pull-secret\") pod \"global-pull-secret-syncer-2kztj\" (UID: \"809f082e-d099-4758-b605-f4d76eedd980\") " pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:42:33.427516 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.427497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9123ce4-5241-47ce-a907-4c44d9e87605-metrics-certs\") pod \"network-metrics-daemon-m72t8\" (UID: \"e9123ce4-5241-47ce-a907-4c44d9e87605\") " pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:42:33.515161 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.515133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:33.518782 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.518763    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:42:33.529715 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.529690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:42:33.539210 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.539187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf65d\" (UniqueName: \"kubernetes.io/projected/d2232a04-6252-410d-a9e3-0e2da0ac5a95-kube-api-access-vf65d\") pod \"network-check-target-kl8gq\" (UID: \"d2232a04-6252-410d-a9e3-0e2da0ac5a95\") " pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:33.550184 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.550160    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cz2v8\""
Jul 09 18:42:33.556346 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.556320    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ppzx8\""
Jul 09 18:42:33.557361 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.557346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:33.563123 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.563095    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m72t8"
Jul 09 18:42:33.643406 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.643354    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2kztj"
Jul 09 18:42:33.918611 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.918576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:33.921215 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.921190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9e5163a-39af-4af8-a583-c09d52cfe568-metrics-tls\") pod \"dns-default-9nl2t\" (UID: \"b9e5163a-39af-4af8-a583-c09d52cfe568\") " pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:33.937838 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.937815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm22z\""
Jul 09 18:42:33.944806 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:33.944785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:35.634492 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:35.634460    2578 scope.go:117] "RemoveContainer" containerID="ae0d45400a7427a610f5d8ad0ff2e32ead667138d35a448db7ad19c966d86651"
Jul 09 18:42:35.788581 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:35.787840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9nl2t"]
Jul 09 18:42:36.036290 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:36.036251    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e5163a_39af_4af8_a583_c09d52cfe568.slice/crio-dd7563469bcc5049f6e1db4eedbce213139b8aa8eb024bce4cad0c96436b9b00 WatchSource:0}: Error finding container dd7563469bcc5049f6e1db4eedbce213139b8aa8eb024bce4cad0c96436b9b00: Status 404 returned error can't find the container with id dd7563469bcc5049f6e1db4eedbce213139b8aa8eb024bce4cad0c96436b9b00
Jul 09 18:42:36.193067 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.193039    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2kztj"]
Jul 09 18:42:36.197058 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:36.197008    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809f082e_d099_4758_b605_f4d76eedd980.slice/crio-0344135b6e9103b847fd076898f7b01608d87c913c99b2b5d928a0c81aabd169 WatchSource:0}: Error finding container 0344135b6e9103b847fd076898f7b01608d87c913c99b2b5d928a0c81aabd169: Status 404 returned error can't find the container with id 0344135b6e9103b847fd076898f7b01608d87c913c99b2b5d928a0c81aabd169
Jul 09 18:42:36.419158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.419071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kl8gq"]
Jul 09 18:42:36.421780 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.421758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m72t8"]
Jul 09 18:42:36.424207 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:36.424177    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2232a04_6252_410d_a9e3_0e2da0ac5a95.slice/crio-b81c6e5ad2f33c23af991b247c57eb9de3add28d4bd6f6343aeefc35d4f4ac38 WatchSource:0}: Error finding container b81c6e5ad2f33c23af991b247c57eb9de3add28d4bd6f6343aeefc35d4f4ac38: Status 404 returned error can't find the container with id b81c6e5ad2f33c23af991b247c57eb9de3add28d4bd6f6343aeefc35d4f4ac38
Jul 09 18:42:36.425492 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:36.425464    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9123ce4_5241_47ce_a907_4c44d9e87605.slice/crio-630b40e30525a4e95ac9f645ae65bdbd4f0e30d9cd250f22d7ea1b36c1bc2ad5 WatchSource:0}: Error finding container 630b40e30525a4e95ac9f645ae65bdbd4f0e30d9cd250f22d7ea1b36c1bc2ad5: Status 404 returned error can't find the container with id 630b40e30525a4e95ac9f645ae65bdbd4f0e30d9cd250f22d7ea1b36c1bc2ad5
Jul 09 18:42:36.763039 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.763001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:36.768621 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.768590    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"]
Jul 09 18:42:36.771978 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.771955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:36.779125 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.779100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ppk4x\""
Jul 09 18:42:36.780495 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.779362    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 18:42:36.793193 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.793171    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"]
Jul 09 18:42:36.800254 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.800233    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"]
Jul 09 18:42:36.800361 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.800299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"
Jul 09 18:42:36.809520 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.809494    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4j5l7\""
Jul 09 18:42:36.809728 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.809711    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 18:42:36.809923 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.809908    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 18:42:36.829937 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.829905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"]
Jul 09 18:42:36.844330 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.844283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67bb3078-e228-4a42-959f-5216834ef670-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-24r26\" (UID: \"67bb3078-e228-4a42-959f-5216834ef670\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:36.894770 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.894731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nl2t" event={"ID":"b9e5163a-39af-4af8-a583-c09d52cfe568","Type":"ContainerStarted","Data":"dd7563469bcc5049f6e1db4eedbce213139b8aa8eb024bce4cad0c96436b9b00"}
Jul 09 18:42:36.898272 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.898245    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:42:36.898410 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.898331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wk2mx" event={"ID":"b06cb015-480d-4404-8465-34535cd2e097","Type":"ContainerStarted","Data":"6ee58961b0fe2f5d0b4db1762222740446953a92cdd5a4318bb7a68df2b3cdb7"}
Jul 09 18:42:36.899291 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.899270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:36.902131 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.902069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kl8gq" event={"ID":"d2232a04-6252-410d-a9e3-0e2da0ac5a95","Type":"ContainerStarted","Data":"b81c6e5ad2f33c23af991b247c57eb9de3add28d4bd6f6343aeefc35d4f4ac38"}
Jul 09 18:42:36.904244 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.904219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8745v" event={"ID":"6eacc620-d573-4101-aa52-c8a9937f88de","Type":"ContainerStarted","Data":"51e68190a5276198b550ccd53adbc94ac8c7736c43492899627b4b0592432cdc"}
Jul 09 18:42:36.906054 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.906035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-wk2mx"
Jul 09 18:42:36.907163 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.907137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m72t8" event={"ID":"e9123ce4-5241-47ce-a907-4c44d9e87605","Type":"ContainerStarted","Data":"630b40e30525a4e95ac9f645ae65bdbd4f0e30d9cd250f22d7ea1b36c1bc2ad5"}
Jul 09 18:42:36.909598 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.909566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2kztj" event={"ID":"809f082e-d099-4758-b605-f4d76eedd980","Type":"ContainerStarted","Data":"0344135b6e9103b847fd076898f7b01608d87c913c99b2b5d928a0c81aabd169"}
Jul 09 18:42:36.919857 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.919833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:36.934937 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.934915    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7458cc6ddf-5f2hl"]
Jul 09 18:42:36.937498 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.936980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-wk2mx" podStartSLOduration=23.418534024 podStartE2EDuration="26.936895113s" totalImagesPullingTime="3.518361089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:36.936701625 +0000 UTC m=+69.745548061" watchObservedRunningTime="2026-07-09 18:42:36.936895113 +0000 UTC m=+69.745741549"
Jul 09 18:42:36.938337 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.938160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:36.942553 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.942533    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 18:42:36.942989 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.942845    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 18:42:36.943482 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.943461    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 18:42:36.944827 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.944807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67bb3078-e228-4a42-959f-5216834ef670-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-24r26\" (UID: \"67bb3078-e228-4a42-959f-5216834ef670\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:36.944917 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.944898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99dv\" (UniqueName: \"kubernetes.io/projected/ca42099a-1aef-4dd3-ab1d-ab08fd69270f-kube-api-access-m99dv\") pod \"migrator-7f59b54f6c-jpq8r\" (UID: \"ca42099a-1aef-4dd3-ab1d-ab08fd69270f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"
Jul 09 18:42:36.949304 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.949282    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xwt7z\""
Jul 09 18:42:36.954362 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.954249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67bb3078-e228-4a42-959f-5216834ef670-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-24r26\" (UID: \"67bb3078-e228-4a42-959f-5216834ef670\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:36.957409 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.956811    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7458cc6ddf-5f2hl"]
Jul 09 18:42:36.958103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:36.957863    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 18:42:37.018664 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.018635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.045782 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.045743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eec638a8-0c17-446e-84cb-5c3c5e591e67-registry-certificates\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.045875 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.045813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eec638a8-0c17-446e-84cb-5c3c5e591e67-trusted-ca\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.045939 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.045890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eec638a8-0c17-446e-84cb-5c3c5e591e67-ca-trust-extracted\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.045994 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.045923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-bound-sa-token\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.045994 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.045973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-registry-tls\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.046096 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.046021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljlqk\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-kube-api-access-ljlqk\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.046152 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.046098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eec638a8-0c17-446e-84cb-5c3c5e591e67-image-registry-private-configuration\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.046152 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.046138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99dv\" (UniqueName: \"kubernetes.io/projected/ca42099a-1aef-4dd3-ab1d-ab08fd69270f-kube-api-access-m99dv\") pod \"migrator-7f59b54f6c-jpq8r\" (UID: \"ca42099a-1aef-4dd3-ab1d-ab08fd69270f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"
Jul 09 18:42:37.046251 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.046167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eec638a8-0c17-446e-84cb-5c3c5e591e67-installation-pull-secrets\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.061418 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:37.061122    2578 projected.go:291] Couldn't get configMap openshift-kube-storage-version-migrator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Jul 09 18:42:37.061418 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:37.061142    2578 projected.go:196] Error preparing data for projected volume kube-api-access-m99dv for pod openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r: configmap "openshift-service-ca.crt" not found
Jul 09 18:42:37.061418 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:37.061197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca42099a-1aef-4dd3-ab1d-ab08fd69270f-kube-api-access-m99dv podName:ca42099a-1aef-4dd3-ab1d-ab08fd69270f nodeName:}" failed. No retries permitted until 2026-07-09 18:42:37.561176406 +0000 UTC m=+70.370022825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m99dv" (UniqueName: "kubernetes.io/projected/ca42099a-1aef-4dd3-ab1d-ab08fd69270f-kube-api-access-m99dv") pod "migrator-7f59b54f6c-jpq8r" (UID: "ca42099a-1aef-4dd3-ab1d-ab08fd69270f") : configmap "openshift-service-ca.crt" not found
Jul 09 18:42:37.087601 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.087413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:37.124808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.124551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.146957 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.146923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eec638a8-0c17-446e-84cb-5c3c5e591e67-ca-trust-extracted\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.146977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-bound-sa-token\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.147001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-registry-tls\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.147042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlqk\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-kube-api-access-ljlqk\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.147077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eec638a8-0c17-446e-84cb-5c3c5e591e67-image-registry-private-configuration\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147323 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.147117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eec638a8-0c17-446e-84cb-5c3c5e591e67-installation-pull-secrets\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147323 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.147149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eec638a8-0c17-446e-84cb-5c3c5e591e67-registry-certificates\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.147323 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.147185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eec638a8-0c17-446e-84cb-5c3c5e591e67-trusted-ca\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.149580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.148359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eec638a8-0c17-446e-84cb-5c3c5e591e67-trusted-ca\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.149580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.148649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eec638a8-0c17-446e-84cb-5c3c5e591e67-ca-trust-extracted\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.151015 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.150963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eec638a8-0c17-446e-84cb-5c3c5e591e67-registry-certificates\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.159161 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.152031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eec638a8-0c17-446e-84cb-5c3c5e591e67-image-registry-private-configuration\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.159161 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.152870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-registry-tls\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.159161 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.153079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eec638a8-0c17-446e-84cb-5c3c5e591e67-installation-pull-secrets\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.167656 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.167560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-bound-sa-token\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.171945 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.171923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlqk\" (UniqueName: \"kubernetes.io/projected/eec638a8-0c17-446e-84cb-5c3c5e591e67-kube-api-access-ljlqk\") pod \"image-registry-7458cc6ddf-5f2hl\" (UID: \"eec638a8-0c17-446e-84cb-5c3c5e591e67\") " pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.217818 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.217733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.256707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.256445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:37.270684 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.270584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"]
Jul 09 18:42:37.274748 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:37.274716    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bb3078_e228_4a42_959f_5216834ef670.slice/crio-dce635807bf156d2943b6f2e6e2596c79440cbbe3788bee9a235ec37c6a4d9b3 WatchSource:0}: Error finding container dce635807bf156d2943b6f2e6e2596c79440cbbe3788bee9a235ec37c6a4d9b3: Status 404 returned error can't find the container with id dce635807bf156d2943b6f2e6e2596c79440cbbe3788bee9a235ec37c6a4d9b3
Jul 09 18:42:37.305829 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.305774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.388046 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.387666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.453313 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.453280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.470322 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.470289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7458cc6ddf-5f2hl"]
Jul 09 18:42:37.653314 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.653239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99dv\" (UniqueName: \"kubernetes.io/projected/ca42099a-1aef-4dd3-ab1d-ab08fd69270f-kube-api-access-m99dv\") pod \"migrator-7f59b54f6c-jpq8r\" (UID: \"ca42099a-1aef-4dd3-ab1d-ab08fd69270f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"
Jul 09 18:42:37.657860 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.657830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99dv\" (UniqueName: \"kubernetes.io/projected/ca42099a-1aef-4dd3-ab1d-ab08fd69270f-kube-api-access-m99dv\") pod \"migrator-7f59b54f6c-jpq8r\" (UID: \"ca42099a-1aef-4dd3-ab1d-ab08fd69270f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"
Jul 09 18:42:37.713292 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.713270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"
Jul 09 18:42:37.796300 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.796153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.897962 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.897929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:37.917837 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.917772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8745v" event={"ID":"6eacc620-d573-4101-aa52-c8a9937f88de","Type":"ContainerStarted","Data":"fff54541761fc46678f71ce29c9908c6996276b0ce05e11ccc7d635af3121289"}
Jul 09 18:42:37.919415 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:37.919358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26" event={"ID":"67bb3078-e228-4a42-959f-5216834ef670","Type":"ContainerStarted","Data":"dce635807bf156d2943b6f2e6e2596c79440cbbe3788bee9a235ec37c6a4d9b3"}
Jul 09 18:42:38.006766 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.006739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:38.108690 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.108659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:38.390167 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:38.390127    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec638a8_0c17_446e_84cb_5c3c5e591e67.slice/crio-47eb83b58db92a9bd2e0365e6e82e9ab137627bdf1808136a3900e9cff8444d8 WatchSource:0}: Error finding container 47eb83b58db92a9bd2e0365e6e82e9ab137627bdf1808136a3900e9cff8444d8: Status 404 returned error can't find the container with id 47eb83b58db92a9bd2e0365e6e82e9ab137627bdf1808136a3900e9cff8444d8
Jul 09 18:42:38.402764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.402736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:38.606824 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.606516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:38.649810 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.649599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r"]
Jul 09 18:42:38.656439 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:38.656410    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca42099a_1aef_4dd3_ab1d_ab08fd69270f.slice/crio-ef041ce2a1d586f23b51e5f40807b999a518016d23ecdb7f0fb4ae8f8fcb3420 WatchSource:0}: Error finding container ef041ce2a1d586f23b51e5f40807b999a518016d23ecdb7f0fb4ae8f8fcb3420: Status 404 returned error can't find the container with id ef041ce2a1d586f23b51e5f40807b999a518016d23ecdb7f0fb4ae8f8fcb3420
Jul 09 18:42:38.929089 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.928408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nl2t" event={"ID":"b9e5163a-39af-4af8-a583-c09d52cfe568","Type":"ContainerStarted","Data":"bbc7c051104e2527d853dcd200f84b70f84bcf0c817b8a3e6167ca9037cbc24e"}
Jul 09 18:42:38.929089 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.928482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9nl2t" event={"ID":"b9e5163a-39af-4af8-a583-c09d52cfe568","Type":"ContainerStarted","Data":"760cf2ca82fd66f63448af298bf6659fb6728433a72ebeaedf62e0c02a36e99b"}
Jul 09 18:42:38.929089 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.928637    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:38.931450 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.931425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m72t8" event={"ID":"e9123ce4-5241-47ce-a907-4c44d9e87605","Type":"ContainerStarted","Data":"d8d61613603d213e40761c140e3c80172738d0096e2e4a5a2366b144209546ab"}
Jul 09 18:42:38.931585 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.931471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m72t8" event={"ID":"e9123ce4-5241-47ce-a907-4c44d9e87605","Type":"ContainerStarted","Data":"dc21ae563bbd7d24c8a97b0fbb885b617dcafff86beabb1a64758534175a1884"}
Jul 09 18:42:38.935221 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.935149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r" event={"ID":"ca42099a-1aef-4dd3-ab1d-ab08fd69270f","Type":"ContainerStarted","Data":"ef041ce2a1d586f23b51e5f40807b999a518016d23ecdb7f0fb4ae8f8fcb3420"}
Jul 09 18:42:38.938182 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.938131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl" event={"ID":"eec638a8-0c17-446e-84cb-5c3c5e591e67","Type":"ContainerStarted","Data":"3a33486ee6987e13e0f28660b8fd2a258cc96057af034c47d04a485c777ef293"}
Jul 09 18:42:38.938182 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.938173    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:42:38.938354 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.938195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl" event={"ID":"eec638a8-0c17-446e-84cb-5c3c5e591e67","Type":"ContainerStarted","Data":"47eb83b58db92a9bd2e0365e6e82e9ab137627bdf1808136a3900e9cff8444d8"}
Jul 09 18:42:38.985537 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.985483    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl" podStartSLOduration=2.9854634989999997 podStartE2EDuration="2.985463499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:38.984754151 +0000 UTC m=+71.793600587" watchObservedRunningTime="2026-07-09 18:42:38.985463499 +0000 UTC m=+71.794309916"
Jul 09 18:42:38.987423 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:38.985836    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9nl2t" podStartSLOduration=34.572257742 podStartE2EDuration="36.985827883s" totalImagesPullingTime="2.413570141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:38.956742142 +0000 UTC m=+71.765588580" watchObservedRunningTime="2026-07-09 18:42:38.985827883 +0000 UTC m=+71.794674321"
Jul 09 18:42:39.008687 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:39.008629    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m72t8" podStartSLOduration=68.991145299 podStartE2EDuration="1m11.008595934s" totalImagesPullingTime="2.017450635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:39.006555043 +0000 UTC m=+71.815401479" watchObservedRunningTime="2026-07-09 18:42:39.008595934 +0000 UTC m=+71.817442369"
Jul 09 18:42:39.122181 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:39.122143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:39.231955 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:39.231884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:40.222136 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:40.222101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:40.324704 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:40.324664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:43.604895 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.604868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:43.704236 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.704189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:43.961066 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.961031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kl8gq" event={"ID":"d2232a04-6252-410d-a9e3-0e2da0ac5a95","Type":"ContainerStarted","Data":"3000d3ced41b5a99c4f8fe075ca84e29327a4be284e187ca8ae454a314f570ce"}
Jul 09 18:42:43.961242 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.961157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:42:43.963575 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.963536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8745v" event={"ID":"6eacc620-d573-4101-aa52-c8a9937f88de","Type":"ContainerStarted","Data":"6f7330448937cfee117b7fcafaa81972ab5e20853a2c35741378a30d59f7eb9a"}
Jul 09 18:42:43.965308 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.965279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26" event={"ID":"67bb3078-e228-4a42-959f-5216834ef670","Type":"ContainerStarted","Data":"89ecb1c9f9a4bce7c365d4e68e4876060fc4634cbd326fa3c7d053b469ea59f0"}
Jul 09 18:42:43.965479 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.965462    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:43.967439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.967409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2kztj" event={"ID":"809f082e-d099-4758-b605-f4d76eedd980","Type":"ContainerStarted","Data":"521b975e1aa1f2afab73a6f2b9746584980b1d844814e4492ac4604e6c71814f"}
Jul 09 18:42:43.969715 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.969688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r" event={"ID":"ca42099a-1aef-4dd3-ab1d-ab08fd69270f","Type":"ContainerStarted","Data":"d17287103d5cda8f0fb2f437410cfea7a2c13abb9b7a27f08e58b1a340ee95c7"}
Jul 09 18:42:43.969887 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.969740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r" event={"ID":"ca42099a-1aef-4dd3-ab1d-ab08fd69270f","Type":"ContainerStarted","Data":"16b39fdf6e298802d87d4dd06e39c9676dd08d2166a7d358d4fc037e6a6b6eb6"}
Jul 09 18:42:43.971176 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.971158    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26"
Jul 09 18:42:43.979813 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.979766    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kl8gq" podStartSLOduration=68.892642114 podStartE2EDuration="1m15.979749957s" totalImagesPullingTime="7.087107843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:43.979415432 +0000 UTC m=+76.788261866" watchObservedRunningTime="2026-07-09 18:42:43.979749957 +0000 UTC m=+76.788596391"
Jul 09 18:42:43.999326 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:43.999281    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jpq8r" podStartSLOduration=3.149366633 podStartE2EDuration="7.999268615s" totalImagesPullingTime="4.849901982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:43.99887725 +0000 UTC m=+76.807723687" watchObservedRunningTime="2026-07-09 18:42:43.999268615 +0000 UTC m=+76.808115049"
Jul 09 18:42:44.022326 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.022286    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2kztj" podStartSLOduration=68.694377539 podStartE2EDuration="1m16.022274295s" totalImagesPullingTime="7.327896756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:44.021527644 +0000 UTC m=+76.830374080" watchObservedRunningTime="2026-07-09 18:42:44.022274295 +0000 UTC m=+76.831120730"
Jul 09 18:42:44.042363 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.042325    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8745v" podStartSLOduration=17.762260439 podStartE2EDuration="29.042313396s" totalImagesPullingTime="11.280052957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:42:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:44.041003362 +0000 UTC m=+76.849849797" watchObservedRunningTime="2026-07-09 18:42:44.042313396 +0000 UTC m=+76.851159831"
Jul 09 18:42:44.060442 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.060406    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-24r26" podStartSLOduration=1.829039045 podStartE2EDuration="8.060370205s" totalImagesPullingTime="6.23133116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:44.05952197 +0000 UTC m=+76.868368407" watchObservedRunningTime="2026-07-09 18:42:44.060370205 +0000 UTC m=+76.869216640"
Jul 09 18:42:44.104432 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.104406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:44.192603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.192569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:44.466417 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.466362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:44.515912 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.515885    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pbbx8"]
Jul 09 18:42:44.520130 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.520111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.525474 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.525419    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 18:42:44.525592 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.525485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 18:42:44.525592 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.525536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-24clm\""
Jul 09 18:42:44.525707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.525430    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 18:42:44.525707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.525423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 18:42:44.525707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.525540    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 18:42:44.530718 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.530690    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pbbx8"]
Jul 09 18:42:44.552439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.552415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:44.611269 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.611246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rnlz\" (UniqueName: \"kubernetes.io/projected/4adbb3df-7225-40ea-ad7f-8ad294e36d65-kube-api-access-8rnlz\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.611607 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.611274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adbb3df-7225-40ea-ad7f-8ad294e36d65-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.611607 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.611313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4adbb3df-7225-40ea-ad7f-8ad294e36d65-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.611607 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.611333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adbb3df-7225-40ea-ad7f-8ad294e36d65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.671511 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.671482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:44.712394 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.712356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4adbb3df-7225-40ea-ad7f-8ad294e36d65-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.712487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.712402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adbb3df-7225-40ea-ad7f-8ad294e36d65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.712487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.712436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rnlz\" (UniqueName: \"kubernetes.io/projected/4adbb3df-7225-40ea-ad7f-8ad294e36d65-kube-api-access-8rnlz\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.712487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.712454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adbb3df-7225-40ea-ad7f-8ad294e36d65-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.713220 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.713148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4adbb3df-7225-40ea-ad7f-8ad294e36d65-metrics-client-ca\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.715156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.715131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4adbb3df-7225-40ea-ad7f-8ad294e36d65-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.715254 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.715232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4adbb3df-7225-40ea-ad7f-8ad294e36d65-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.726751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.726700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rnlz\" (UniqueName: \"kubernetes.io/projected/4adbb3df-7225-40ea-ad7f-8ad294e36d65-kube-api-access-8rnlz\") pod \"prometheus-operator-64785b6675-pbbx8\" (UID: \"4adbb3df-7225-40ea-ad7f-8ad294e36d65\") " pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.830534 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.830503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8"
Jul 09 18:42:44.957920 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.957823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-pbbx8"]
Jul 09 18:42:44.960394 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:44.960353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adbb3df_7225_40ea_ad7f_8ad294e36d65.slice/crio-e5b17e7eb63b8f2b057be8e1bcd61d82762a23ba4baf0972c82b39530155e233 WatchSource:0}: Error finding container e5b17e7eb63b8f2b057be8e1bcd61d82762a23ba4baf0972c82b39530155e233: Status 404 returned error can't find the container with id e5b17e7eb63b8f2b057be8e1bcd61d82762a23ba4baf0972c82b39530155e233
Jul 09 18:42:44.975111 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:44.975082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8" event={"ID":"4adbb3df-7225-40ea-ad7f-8ad294e36d65","Type":"ContainerStarted","Data":"e5b17e7eb63b8f2b057be8e1bcd61d82762a23ba4baf0972c82b39530155e233"}
Jul 09 18:42:46.715514 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:46.715479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:46.819473 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:46.819398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:46.892398 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:46.892337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:46.959722 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:46.959698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:46.985810 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:46.985781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8" event={"ID":"4adbb3df-7225-40ea-ad7f-8ad294e36d65","Type":"ContainerStarted","Data":"988df79978f208f20c3e3e3b8150b44c82df30f1b9815f9038596d8b5806c73d"}
Jul 09 18:42:46.985916 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:46.985864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8" event={"ID":"4adbb3df-7225-40ea-ad7f-8ad294e36d65","Type":"ContainerStarted","Data":"ad36a66b8c53f1fe940e5dc373aa84be02a8b8be99ba54c6d387162fe1d2c241"}
Jul 09 18:42:47.006181 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:47.006134    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-pbbx8" podStartSLOduration=1.403282686 podStartE2EDuration="3.006121439s" totalImagesPullingTime="1.602838753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:47.005135239 +0000 UTC m=+79.813981676" watchObservedRunningTime="2026-07-09 18:42:47.006121439 +0000 UTC m=+79.814967874"
Jul 09 18:42:47.485988 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:47.485956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:47.563587 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:47.563567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:48.651838 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.651720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:48.781467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.781436    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:48.903838 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.903784    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"]
Jul 09 18:42:48.906517 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.906502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:48.909061 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.909019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:48.909566 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.909547    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 18:42:48.909566 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.909558    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4jvsm\""
Jul 09 18:42:48.909712 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.909561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 18:42:48.928626 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.928604    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"]
Jul 09 18:42:48.943935 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.943918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9nl2t"
Jul 09 18:42:48.960703 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.960680    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lln5z"]
Jul 09 18:42:48.963293 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.963276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:48.968559 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.968541    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 18:42:48.969270 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.969255    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 18:42:48.970137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.970116    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-72qx8\""
Jul 09 18:42:48.982005 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:48.981982    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 18:42:49.041211 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8ml\" (UniqueName: \"kubernetes.io/projected/5137ceed-0af1-4527-9ebd-864d213caefc-kube-api-access-bx8ml\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.041317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-sys\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-wtmp\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5137ceed-0af1-4527-9ebd-864d213caefc-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.041317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.041489 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-root\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041489 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjjr\" (UniqueName: \"kubernetes.io/projected/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-kube-api-access-qdjjr\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041561 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.041605 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041648 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-metrics-client-ca\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041697 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-textfile\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041745 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.041799 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.041765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-tls\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.047784 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.047759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:49.142314 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.142444 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-root\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142444 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjjr\" (UniqueName: \"kubernetes.io/projected/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-kube-api-access-qdjjr\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142444 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.142444 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-root\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:49.142458    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:42:49.142528    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-tls podName:5137ceed-0af1-4527-9ebd-864d213caefc nodeName:}" failed. No retries permitted until 2026-07-09 18:42:49.642506409 +0000 UTC m=+82.451352836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-t87sh" (UID: "5137ceed-0af1-4527-9ebd-864d213caefc") : secret "openshift-state-metrics-tls" not found
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-metrics-client-ca\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-textfile\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-tls\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8ml\" (UniqueName: \"kubernetes.io/projected/5137ceed-0af1-4527-9ebd-864d213caefc-kube-api-access-bx8ml\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-sys\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-wtmp\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.142816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5137ceed-0af1-4527-9ebd-864d213caefc-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.143348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.142958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-textfile\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.143348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.143032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-sys\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.143348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.143084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-metrics-client-ca\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.143348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.143129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.143348 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.143239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-wtmp\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.143849 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.143721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5137ceed-0af1-4527-9ebd-864d213caefc-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.145012 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.144984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.145196 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.145171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-tls\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.145282 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.145266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.152829 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.152802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:49.155708 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.155658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjjr\" (UniqueName: \"kubernetes.io/projected/901d31b1-5e8c-4d21-996e-c86fa62c5b0f-kube-api-access-qdjjr\") pod \"node-exporter-lln5z\" (UID: \"901d31b1-5e8c-4d21-996e-c86fa62c5b0f\") " pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.156429 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.156407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8ml\" (UniqueName: \"kubernetes.io/projected/5137ceed-0af1-4527-9ebd-864d213caefc-kube-api-access-bx8ml\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.248964 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.248940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:49.275623 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.275604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lln5z"
Jul 09 18:42:49.286903 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:49.286883    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901d31b1_5e8c_4d21_996e_c86fa62c5b0f.slice/crio-1d4bbeb004ae6d0c882e87ed991361da53a9a426b60ebb58996af6395b458793 WatchSource:0}: Error finding container 1d4bbeb004ae6d0c882e87ed991361da53a9a426b60ebb58996af6395b458793: Status 404 returned error can't find the container with id 1d4bbeb004ae6d0c882e87ed991361da53a9a426b60ebb58996af6395b458793
Jul 09 18:42:49.420302 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.420274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:49.569609 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.569578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:49.646329 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.646303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.648707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.648689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5137ceed-0af1-4527-9ebd-864d213caefc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t87sh\" (UID: \"5137ceed-0af1-4527-9ebd-864d213caefc\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.815698 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.815638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"
Jul 09 18:42:49.917838 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.917789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:49.976321 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.976288    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh"]
Jul 09 18:42:49.998267 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.998237    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh" event={"ID":"5137ceed-0af1-4527-9ebd-864d213caefc","Type":"ContainerStarted","Data":"12e00a2147338278d5b4d0f11b56b45dac2291fb5e6675315814710128f9a592"}
Jul 09 18:42:49.999356 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:49.999332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lln5z" event={"ID":"901d31b1-5e8c-4d21-996e-c86fa62c5b0f","Type":"ContainerStarted","Data":"1d4bbeb004ae6d0c882e87ed991361da53a9a426b60ebb58996af6395b458793"}
Jul 09 18:42:50.015647 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:50.015576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:50.363522 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:50.363431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:51.006313 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.006276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh" event={"ID":"5137ceed-0af1-4527-9ebd-864d213caefc","Type":"ContainerStarted","Data":"6b6cc53ae57311628503798b68b517200c9a247f08aecf74f5ae388aeeaf08b8"}
Jul 09 18:42:51.006757 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.006353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh" event={"ID":"5137ceed-0af1-4527-9ebd-864d213caefc","Type":"ContainerStarted","Data":"4751a2a6248c2482588edc7ac3c560fcba850fedd2848dc6a3b562817a928c75"}
Jul 09 18:42:51.008187 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.008156    2578 generic.go:356] "Generic (PLEG): container finished" podID="901d31b1-5e8c-4d21-996e-c86fa62c5b0f" containerID="570458caa0c57c008f9ade67d227daeb71b0555976b1e42545d96d315419fb59" exitCode=0
Jul 09 18:42:51.008312 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.008206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lln5z" event={"ID":"901d31b1-5e8c-4d21-996e-c86fa62c5b0f","Type":"ContainerDied","Data":"570458caa0c57c008f9ade67d227daeb71b0555976b1e42545d96d315419fb59"}
Jul 09 18:42:51.076572 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.076549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:51.176867 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.176826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:51.300301 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.300216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:51.873241 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.873198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:51.915756 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.915729    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"]
Jul 09 18:42:51.919293 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.919274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:51.922572 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.922554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 18:42:51.923037 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.922993    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 18:42:51.923116 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.923046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 18:42:51.923116 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.923046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 18:42:51.924226 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.924209    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hm2n6\""
Jul 09 18:42:51.924320 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.924208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 18:42:51.924320 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.924279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-76vp36s4fs75b\""
Jul 09 18:42:51.930638 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.930614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"]
Jul 09 18:42:51.947287 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:51.947267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:52.013757 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.013732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh" event={"ID":"5137ceed-0af1-4527-9ebd-864d213caefc","Type":"ContainerStarted","Data":"5cc234edbd3863e6e92bbca70ef3afbf72fc6a41fd006d1b17dbd9e2e2de153b"}
Jul 09 18:42:52.016041 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.016021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lln5z" event={"ID":"901d31b1-5e8c-4d21-996e-c86fa62c5b0f","Type":"ContainerStarted","Data":"ef96a1bd29c18a7a13b9c4aba0617b0055d7f7aac886ee1b91e92158aa426e11"}
Jul 09 18:42:52.016113 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.016060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lln5z" event={"ID":"901d31b1-5e8c-4d21-996e-c86fa62c5b0f","Type":"ContainerStarted","Data":"0575b6d16de49400424f4a27d9c841ee08d7e05cf31101fe94757b42ac2e5309"}
Jul 09 18:42:52.034359 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.034314    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t87sh" podStartSLOduration=3.031076591 podStartE2EDuration="4.034302662s" totalImagesPullingTime="1.003226071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:52.034070239 +0000 UTC m=+84.842916674" watchObservedRunningTime="2026-07-09 18:42:52.034302662 +0000 UTC m=+84.843149097"
Jul 09 18:42:52.060519 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.060485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lln5z" podStartSLOduration=2.912471895 podStartE2EDuration="4.06047454s" totalImagesPullingTime="1.079527987s" totalInitContainerRuntime="68.474658ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:52.059612811 +0000 UTC m=+84.868459246" watchObservedRunningTime="2026-07-09 18:42:52.06047454 +0000 UTC m=+84.869320954"
Jul 09 18:42:52.065889 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.065871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.065965 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.065898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.065965 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.065920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.066044 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.066009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.066079 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.066055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-tls\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.066079 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.066075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d69r\" (UniqueName: \"kubernetes.io/projected/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-kube-api-access-4d69r\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.066153 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.066113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-metrics-client-ca\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.066153 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.066146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-grpc-tls\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167172 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-tls\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167172 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d69r\" (UniqueName: \"kubernetes.io/projected/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-kube-api-access-4d69r\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167314 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-metrics-client-ca\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167314 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-grpc-tls\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167453 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167453 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167453 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167633 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.167976 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.167948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-metrics-client-ca\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.170221 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.170194    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.170358 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.170337    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.170757 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.170735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.170829 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.170786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-grpc-tls\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.170888 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.170841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-tls\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.171183 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.171164    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.177442 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.177420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d69r\" (UniqueName: \"kubernetes.io/projected/6987aba0-070f-4afd-86ab-e3fd89bc7b5d-kube-api-access-4d69r\") pod \"thanos-querier-ff4dbdd9-pxdsf\" (UID: \"6987aba0-070f-4afd-86ab-e3fd89bc7b5d\") " pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.230477 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.230454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:52.364662 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.364616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"]
Jul 09 18:42:52.366820 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:52.366793    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6987aba0_070f_4afd_86ab_e3fd89bc7b5d.slice/crio-08fac335ebe2e55d2723834b4f6806826b4f497dcf286f0192a72bd7f9654536 WatchSource:0}: Error finding container 08fac335ebe2e55d2723834b4f6806826b4f497dcf286f0192a72bd7f9654536: Status 404 returned error can't find the container with id 08fac335ebe2e55d2723834b4f6806826b4f497dcf286f0192a72bd7f9654536
Jul 09 18:42:52.423674 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.423649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:52.493245 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.493218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:52.718572 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.718506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:52.794111 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:52.794078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:53.024488 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.024410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"08fac335ebe2e55d2723834b4f6806826b4f497dcf286f0192a72bd7f9654536"}
Jul 09 18:42:53.297781 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.297710    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cbf44df87-22bff"]
Jul 09 18:42:53.300850 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.300832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.306450 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.306424    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-drtds\""
Jul 09 18:42:53.306957 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.306936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 18:42:53.308402 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.308357    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 18:42:53.308486 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.308415    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 18:42:53.308486 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.308478    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 18:42:53.308674 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.308657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5457e7ng08vv1\""
Jul 09 18:42:53.316393 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.316356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cbf44df87-22bff"]
Jul 09 18:42:53.479667 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-secret-metrics-server-tls\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.479773 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cfbae5b6-95e7-4294-ad08-ff87b29021c1-audit-log\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.479773 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbj8k\" (UniqueName: \"kubernetes.io/projected/cfbae5b6-95e7-4294-ad08-ff87b29021c1-kube-api-access-gbj8k\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.479901 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-client-ca-bundle\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.479901 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-secret-metrics-server-client-certs\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.479901 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfbae5b6-95e7-4294-ad08-ff87b29021c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.480052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.479910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cfbae5b6-95e7-4294-ad08-ff87b29021c1-metrics-server-audit-profiles\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580643 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-secret-metrics-server-tls\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580643 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cfbae5b6-95e7-4294-ad08-ff87b29021c1-audit-log\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbj8k\" (UniqueName: \"kubernetes.io/projected/cfbae5b6-95e7-4294-ad08-ff87b29021c1-kube-api-access-gbj8k\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-client-ca-bundle\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-secret-metrics-server-client-certs\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfbae5b6-95e7-4294-ad08-ff87b29021c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.580787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cfbae5b6-95e7-4294-ad08-ff87b29021c1-metrics-server-audit-profiles\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.581029 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.580994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cfbae5b6-95e7-4294-ad08-ff87b29021c1-audit-log\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.581694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.581671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cfbae5b6-95e7-4294-ad08-ff87b29021c1-metrics-server-audit-profiles\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.581694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.581683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfbae5b6-95e7-4294-ad08-ff87b29021c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.583202 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.583179    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-client-ca-bundle\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.583301 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.583209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-secret-metrics-server-tls\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.583396 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.583361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cfbae5b6-95e7-4294-ad08-ff87b29021c1-secret-metrics-server-client-certs\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.594399 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.594350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbj8k\" (UniqueName: \"kubernetes.io/projected/cfbae5b6-95e7-4294-ad08-ff87b29021c1-kube-api-access-gbj8k\") pod \"metrics-server-5cbf44df87-22bff\" (UID: \"cfbae5b6-95e7-4294-ad08-ff87b29021c1\") " pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.612247 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.612219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:42:53.694756 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.694719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:53.755648 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.755625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cbf44df87-22bff"]
Jul 09 18:42:53.758300 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:53.758265    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbae5b6_95e7_4294_ad08_ff87b29021c1.slice/crio-ada7c95217ba46cb0c0632673d5717763a2500d7b281c6c67ff4f6eed658f7b4 WatchSource:0}: Error finding container ada7c95217ba46cb0c0632673d5717763a2500d7b281c6c67ff4f6eed658f7b4: Status 404 returned error can't find the container with id ada7c95217ba46cb0c0632673d5717763a2500d7b281c6c67ff4f6eed658f7b4
Jul 09 18:42:53.769529 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:53.769453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:54.029111 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.029081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff" event={"ID":"cfbae5b6-95e7-4294-ad08-ff87b29021c1","Type":"ContainerStarted","Data":"ada7c95217ba46cb0c0632673d5717763a2500d7b281c6c67ff4f6eed658f7b4"}
Jul 09 18:42:54.176345 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.176318    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"]
Jul 09 18:42:54.179974 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.179950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.184551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.183846    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 18:42:54.184551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.184001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 18:42:54.184551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.184102    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 18:42:54.184551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.184267    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kpdgz\""
Jul 09 18:42:54.184551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.184349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 18:42:54.184551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.184518    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 18:42:54.191345 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.191290    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 18:42:54.193896 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.193876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"]
Jul 09 18:42:54.287956 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.287889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llpns\" (UniqueName: \"kubernetes.io/projected/0a7127ab-0cf7-496d-a179-43e2571bdd3c-kube-api-access-llpns\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.287956 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.287927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-serving-certs-ca-bundle\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.288156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.287963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.288156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.287997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-federate-client-tls\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.288156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.288066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-telemeter-client-tls\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.288156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.288093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-metrics-client-ca\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.288156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.288117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.288156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.288148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-secret-telemeter-client\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.355920 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.355785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:54.388528 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-telemeter-client-tls\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-metrics-client-ca\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-secret-telemeter-client\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llpns\" (UniqueName: \"kubernetes.io/projected/0a7127ab-0cf7-496d-a179-43e2571bdd3c-kube-api-access-llpns\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-serving-certs-ca-bundle\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.388764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.388734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-federate-client-tls\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.389294 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.389271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-metrics-client-ca\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.390608 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.390581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-serving-certs-ca-bundle\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.390772 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.390743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a7127ab-0cf7-496d-a179-43e2571bdd3c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.391717 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.391673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-telemeter-client-tls\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.392170 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.392145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.392644 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.392610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-secret-telemeter-client\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.392720 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.392643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0a7127ab-0cf7-496d-a179-43e2571bdd3c-federate-client-tls\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.402780 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.402757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llpns\" (UniqueName: \"kubernetes.io/projected/0a7127ab-0cf7-496d-a179-43e2571bdd3c-kube-api-access-llpns\") pod \"telemeter-client-75644fdfc6-m2vgh\" (UID: \"0a7127ab-0cf7-496d-a179-43e2571bdd3c\") " pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.497990 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.497965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"
Jul 09 18:42:54.700786 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:54.700520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75644fdfc6-m2vgh"]
Jul 09 18:42:54.703320 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:42:54.703288    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7127ab_0cf7_496d_a179_43e2571bdd3c.slice/crio-0d459f36659d7aff8d8ab650264e1d75a5b3ea0c3bddabf973116d2cc62e9a0c WatchSource:0}: Error finding container 0d459f36659d7aff8d8ab650264e1d75a5b3ea0c3bddabf973116d2cc62e9a0c: Status 404 returned error can't find the container with id 0d459f36659d7aff8d8ab650264e1d75a5b3ea0c3bddabf973116d2cc62e9a0c
Jul 09 18:42:55.035863 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:55.035819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"6467b9bac1f8823b651b76a03a2fe522e644ec386057d5496f9905c128b48892"}
Jul 09 18:42:55.036328 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:55.035896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"7011871a8c49549727dcb8f4299a42515892dfdd5caa220e83591a92a829b2a3"}
Jul 09 18:42:55.036328 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:55.035937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"c1f790171a9f268e8a3fab85a80fea10b11f980bea0fb49abad0a4f91351ddd5"}
Jul 09 18:42:55.037336 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:55.037309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh" event={"ID":"0a7127ab-0cf7-496d-a179-43e2571bdd3c","Type":"ContainerStarted","Data":"0d459f36659d7aff8d8ab650264e1d75a5b3ea0c3bddabf973116d2cc62e9a0c"}
Jul 09 18:42:55.176594 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:55.176541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:55.290853 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:55.290807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:57.047137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.047102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff" event={"ID":"cfbae5b6-95e7-4294-ad08-ff87b29021c1","Type":"ContainerStarted","Data":"d147c3c9a2d052039b2e7424e8be583fbbc4f2886586fe5c396e9ef72f9658e9"}
Jul 09 18:42:57.049974 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.049944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"c9b9bcf2842c3c016291191d910e7e3645dfafba4e2d0e1b0a3fc04546103580"}
Jul 09 18:42:57.050080 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.050012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"5c95a3e5cb37a5cfb67cf881dba8c3d283a3a3c9e73b7d6985f610c413b295fe"}
Jul 09 18:42:57.050127 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.050086    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:42:57.050127 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.050115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" event={"ID":"6987aba0-070f-4afd-86ab-e3fd89bc7b5d","Type":"ContainerStarted","Data":"21051a225c0584283a93e5b0b9f6c1c6789e25f8592b5e062c295e1a09b981c4"}
Jul 09 18:42:57.068759 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.068720    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff" podStartSLOduration=1.856208479 podStartE2EDuration="4.068706752s" totalImagesPullingTime="2.212498273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:57.067978916 +0000 UTC m=+89.876825355" watchObservedRunningTime="2026-07-09 18:42:57.068706752 +0000 UTC m=+89.877553231"
Jul 09 18:42:57.094072 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.094035    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf" podStartSLOduration=2.722153726 podStartE2EDuration="6.094022237s" totalImagesPullingTime="3.371868511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:57.09245363 +0000 UTC m=+89.901300067" watchObservedRunningTime="2026-07-09 18:42:57.094022237 +0000 UTC m=+89.902868670"
Jul 09 18:42:57.626884 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:57.626844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:58.057973 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:58.057928    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh" event={"ID":"0a7127ab-0cf7-496d-a179-43e2571bdd3c","Type":"ContainerStarted","Data":"2741df05a2df4e7fbc24de00008216975a4b5f3254815420ac1dd978b835951b"}
Jul 09 18:42:58.207220 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:58.207185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:58.306289 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:58.306256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:42:59.063267 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:59.063232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh" event={"ID":"0a7127ab-0cf7-496d-a179-43e2571bdd3c","Type":"ContainerStarted","Data":"cd54be553e5cbafd569b23ef6de59257c859df699d25c635d3968a303b810e40"}
Jul 09 18:42:59.063646 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:59.063293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh" event={"ID":"0a7127ab-0cf7-496d-a179-43e2571bdd3c","Type":"ContainerStarted","Data":"f0f66b592a18ea3aaeb394fe826a83ef8aef71485ad6b9c0802557bde3391e94"}
Jul 09 18:42:59.107839 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:59.107457    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75644fdfc6-m2vgh" podStartSLOduration=1.484806966 podStartE2EDuration="5.107414814s" totalImagesPullingTime="3.622607848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:59.101635424 +0000 UTC m=+91.910481860" watchObservedRunningTime="2026-07-09 18:42:59.107414814 +0000 UTC m=+91.916261250"
Jul 09 18:42:59.945684 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:42:59.945657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7458cc6ddf-5f2hl"
Jul 09 18:43:00.122610 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:00.122579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:00.223281 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:00.223211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:00.324810 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:00.324786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:01.814887 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:01.814848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:01.911089 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:01.911062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:02.485927 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:02.485884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:02.584094 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:02.584069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:03.064931 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:03.064903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ff4dbdd9-pxdsf"
Jul 09 18:43:06.273794 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:06.273763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:06.362575 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:06.362548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:07.184182 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:07.184145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:07.278292 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:07.278258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:07.846782 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:07.846755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:07.922546 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:07.922514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:12.860511 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:12.860480    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:12.963317 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:12.963287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:13.045312 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:13.045285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:13.599449 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:13.599418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:13.612463 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:13.612435    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:43:13.612582 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:13.612487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:43:13.680959 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:13.680929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:14.978142 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:14.978116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kl8gq"
Jul 09 18:43:16.819518 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:16.819479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:16.920426 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:16.920373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:28.659778 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:28.659737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:28.771178 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:28.771144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:43:33.620216 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:33.620174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:43:33.624261 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:33.624217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cbf44df87-22bff"
Jul 09 18:43:36.209244 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:36.209204    2578 generic.go:356] "Generic (PLEG): container finished" podID="a4a760bd-aa99-493a-b090-663f814d45da" containerID="d07d858f04bb4e0dbd0d06d52c9ddda000f165940cc6cabadccbfe6ca40d7493" exitCode=0
Jul 09 18:43:36.209738 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:36.209283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq" event={"ID":"a4a760bd-aa99-493a-b090-663f814d45da","Type":"ContainerDied","Data":"d07d858f04bb4e0dbd0d06d52c9ddda000f165940cc6cabadccbfe6ca40d7493"}
Jul 09 18:43:36.209738 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:36.209728    2578 scope.go:117] "RemoveContainer" containerID="d07d858f04bb4e0dbd0d06d52c9ddda000f165940cc6cabadccbfe6ca40d7493"
Jul 09 18:43:37.215572 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:37.215538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-qwdbq" event={"ID":"a4a760bd-aa99-493a-b090-663f814d45da","Type":"ContainerStarted","Data":"c58d178b0f062ea7a63039427612457f1ec9fad122ef02e7ea9b93013ec6aff7"}
Jul 09 18:43:46.743143 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:43:46.743098    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:05.039843 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:05.039803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:05.104059 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:05.104030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:09.735540 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:09.735493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:10.342540 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.342509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:10.408662 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.408633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:10.786363 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.786330    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:44:10.791881 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.791862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.796832 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.796799    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 18:44:10.797094 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.797077    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 18:44:10.797174 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.797109    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tdfjh\""
Jul 09 18:44:10.797518 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.797478    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 18:44:10.797629 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.797532    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 18:44:10.797930 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.797903    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 18:44:10.798028 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.797942    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 18:44:10.798090 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.798023    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 18:44:10.798472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.798456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 18:44:10.804667 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.804651    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 18:44:10.813869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.813846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:44:10.965543 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dad6272-0ab0-470c-ab98-713a42bc7dca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965640 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965640 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dad6272-0ab0-470c-ab98-713a42bc7dca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965640 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-web-config\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0dad6272-0ab0-470c-ab98-713a42bc7dca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrbl\" (UniqueName: \"kubernetes.io/projected/0dad6272-0ab0-470c-ab98-713a42bc7dca-kube-api-access-2xrbl\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965758 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-config-volume\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965928 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dad6272-0ab0-470c-ab98-713a42bc7dca-config-out\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965928 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dad6272-0ab0-470c-ab98-713a42bc7dca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965928 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:10.965928 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:10.965832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066354 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dad6272-0ab0-470c-ab98-713a42bc7dca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066354 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066486 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-web-config\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066486 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066486 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0dad6272-0ab0-470c-ab98-713a42bc7dca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066486 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrbl\" (UniqueName: \"kubernetes.io/projected/0dad6272-0ab0-470c-ab98-713a42bc7dca-kube-api-access-2xrbl\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066655 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-config-volume\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066655 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dad6272-0ab0-470c-ab98-713a42bc7dca-config-out\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dad6272-0ab0-470c-ab98-713a42bc7dca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066896 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dad6272-0ab0-470c-ab98-713a42bc7dca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.066896 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.067000 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.066931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0dad6272-0ab0-470c-ab98-713a42bc7dca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.067158 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.067129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dad6272-0ab0-470c-ab98-713a42bc7dca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.068347 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.068322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dad6272-0ab0-470c-ab98-713a42bc7dca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.069547 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.069524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0dad6272-0ab0-470c-ab98-713a42bc7dca-config-out\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.070201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.069652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.070201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.069978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.070201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.070041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-web-config\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.070201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.070102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.070201 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.070131    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.070801 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.070778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.071167 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.071144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0dad6272-0ab0-470c-ab98-713a42bc7dca-config-volume\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.071441 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.071424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0dad6272-0ab0-470c-ab98-713a42bc7dca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.076404 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.076362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrbl\" (UniqueName: \"kubernetes.io/projected/0dad6272-0ab0-470c-ab98-713a42bc7dca-kube-api-access-2xrbl\") pod \"alertmanager-main-0\" (UID: \"0dad6272-0ab0-470c-ab98-713a42bc7dca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.103365 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.103343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 18:44:11.244148 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.244119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 18:44:11.246897 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:44:11.246872    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dad6272_0ab0_470c_ab98_713a42bc7dca.slice/crio-512d242ad5dc898d0ae5a3b2f4d58dc205a7e024e522767de10ed8510c0b9603 WatchSource:0}: Error finding container 512d242ad5dc898d0ae5a3b2f4d58dc205a7e024e522767de10ed8510c0b9603: Status 404 returned error can't find the container with id 512d242ad5dc898d0ae5a3b2f4d58dc205a7e024e522767de10ed8510c0b9603
Jul 09 18:44:11.355496 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.355467    2578 generic.go:356] "Generic (PLEG): container finished" podID="0dad6272-0ab0-470c-ab98-713a42bc7dca" containerID="989f7f95d5ddde0c1271305bd91a1dcc05ab268fa7da0471a746f063c96cafad" exitCode=0
Jul 09 18:44:11.355600 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.355514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerDied","Data":"989f7f95d5ddde0c1271305bd91a1dcc05ab268fa7da0471a746f063c96cafad"}
Jul 09 18:44:11.355600 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:11.355563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"512d242ad5dc898d0ae5a3b2f4d58dc205a7e024e522767de10ed8510c0b9603"}
Jul 09 18:44:13.367634 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.367556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"190242b321c6d650a14979a9df4d2951ba9f7f2695171767f36259dbf23854dc"}
Jul 09 18:44:13.367988 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.367642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"09e47be10a061d0b9b1fb520ebe2207f83d5f2a12f987997253e6de2d30d40f3"}
Jul 09 18:44:13.367988 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.367689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"02114d8062851bd591bd5f6167b561c5df48b482602e6e7daa4e9ae5c4e265d7"}
Jul 09 18:44:13.367988 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.367733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"0706d080a68b55f48f3941ae7e56e36bcd7cf4d17d98ece366650eaae11c6960"}
Jul 09 18:44:13.367988 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.367775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"24145cadd9b4530574dc5167a392a7800bc1e8512ff3c2177afb9978d704bd59"}
Jul 09 18:44:13.367988 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.367813    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0dad6272-0ab0-470c-ab98-713a42bc7dca","Type":"ContainerStarted","Data":"d49eb72ee4f9ddb61e7dee9815a80a5eb2183b338946466c1af745b9e3c4721d"}
Jul 09 18:44:13.413099 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:13.413050    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.082653425 podStartE2EDuration="3.413034302s" totalImagesPullingTime="1.314918052s" totalInitContainerRuntime="15.462825ms" isStatefulPod=false podCreationTimestamp="2026-07-09 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:44:13.409938692 +0000 UTC m=+166.218785126" watchObservedRunningTime="2026-07-09 18:44:13.413034302 +0000 UTC m=+166.221880737"
Jul 09 18:44:16.981140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:16.981102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:17.102657 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:17.102628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:21.159295 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:21.159194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:21.259860 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:21.259824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:21.360368 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:21.360341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:28.609061 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:28.609018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:44:28.708710 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:44:28.708663    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:06.952170 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:06.952121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:07.018509 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:07.018481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:09.509871 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:09.509829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:09.609352 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:09.609305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:36.511184 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:36.511150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:37.320452 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:37.320415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:38.415191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:38.415148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:38.528761 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:38.528727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:40.110245 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:40.110203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:40.213629 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:40.213590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:41.666941 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:41.666905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:42.041512 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:42.041462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:44.103998 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:44.103962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:44.502641 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:44.502601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:46.917917 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:46.917872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:46.991030 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:46.990996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:47.180888 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:47.180861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:48.852950 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.852859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k68rp"]
Jul 09 18:45:48.856441 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.856418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:48.860022 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.859994    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 18:45:48.860195 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.860060    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 18:45:48.861754 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.861726    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-86dw7\""
Jul 09 18:45:48.867981 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.867956    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k68rp"]
Jul 09 18:45:48.909387 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.909346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4989add7-6ddc-40d0-8e2b-83326c335505-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k68rp\" (UID: \"4989add7-6ddc-40d0-8e2b-83326c335505\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:48.909481 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:48.909415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pznq7\" (UniqueName: \"kubernetes.io/projected/4989add7-6ddc-40d0-8e2b-83326c335505-kube-api-access-pznq7\") pod \"cert-manager-webhook-6486ffd997-k68rp\" (UID: \"4989add7-6ddc-40d0-8e2b-83326c335505\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:49.010034 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.010005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pznq7\" (UniqueName: \"kubernetes.io/projected/4989add7-6ddc-40d0-8e2b-83326c335505-kube-api-access-pznq7\") pod \"cert-manager-webhook-6486ffd997-k68rp\" (UID: \"4989add7-6ddc-40d0-8e2b-83326c335505\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:49.010139 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.010067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4989add7-6ddc-40d0-8e2b-83326c335505-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k68rp\" (UID: \"4989add7-6ddc-40d0-8e2b-83326c335505\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:49.021238 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.021206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4989add7-6ddc-40d0-8e2b-83326c335505-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k68rp\" (UID: \"4989add7-6ddc-40d0-8e2b-83326c335505\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:49.021332 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.021274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pznq7\" (UniqueName: \"kubernetes.io/projected/4989add7-6ddc-40d0-8e2b-83326c335505-kube-api-access-pznq7\") pod \"cert-manager-webhook-6486ffd997-k68rp\" (UID: \"4989add7-6ddc-40d0-8e2b-83326c335505\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:49.180967 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.180948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:49.318557 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.318534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k68rp"]
Jul 09 18:45:49.321077 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:45:49.321049    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4989add7_6ddc_40d0_8e2b_83326c335505.slice/crio-abf5546475b53a413f34859f1169893505d9b5990e893b42f20cfe5c1b947826 WatchSource:0}: Error finding container abf5546475b53a413f34859f1169893505d9b5990e893b42f20cfe5c1b947826: Status 404 returned error can't find the container with id abf5546475b53a413f34859f1169893505d9b5990e893b42f20cfe5c1b947826
Jul 09 18:45:49.783909 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:49.783883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp" event={"ID":"4989add7-6ddc-40d0-8e2b-83326c335505","Type":"ContainerStarted","Data":"abf5546475b53a413f34859f1169893505d9b5990e893b42f20cfe5c1b947826"}
Jul 09 18:45:51.708033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:51.707997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:52.474370 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:52.474289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:52.567699 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:52.567669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:52.802207 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:52.802136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp" event={"ID":"4989add7-6ddc-40d0-8e2b-83326c335505","Type":"ContainerStarted","Data":"841668e8a21ae2bc8db8227af2250ce991df7444b30fc4aa8ef07529d3332ccc"}
Jul 09 18:45:52.802567 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:52.802255    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:52.823236 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:52.823188    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp" podStartSLOduration=1.938137124 podStartE2EDuration="4.823170579s" totalImagesPullingTime="2.885033455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:52.820895618 +0000 UTC m=+265.629742054" watchObservedRunningTime="2026-07-09 18:45:52.823170579 +0000 UTC m=+265.632017014"
Jul 09 18:45:52.927236 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:52.927215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:53.021909 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:53.021885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:58.808473 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:58.808435    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k68rp"
Jul 09 18:45:59.800172 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:59.800138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:45:59.890129 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:45:59.890094    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:01.829544 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:01.829506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:19.853869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:19.853827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:19.954276 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:19.954242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:20.480620 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.480583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:20.749754 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.749657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:20.852986 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.852960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:20.883416 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.883391    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"]
Jul 09 18:46:20.918732 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.918708    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"]
Jul 09 18:46:20.918837 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.918823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:20.923939 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.923917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 18:46:20.924052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.923950    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-st4z8\""
Jul 09 18:46:20.924052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.923987    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 18:46:20.924251 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.924238    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 18:46:20.924449 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:20.924438    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 18:46:21.049477 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.049416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49d15505-2aa1-427d-bbb4-f57b4ed47f22-manifests\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.049477 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.049457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49d15505-2aa1-427d-bbb4-f57b4ed47f22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.049594 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.049482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d15505-2aa1-427d-bbb4-f57b4ed47f22-webhook-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.049594 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.049568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49d15505-2aa1-427d-bbb4-f57b4ed47f22-tmp\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.049658 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.049609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmhzt\" (UniqueName: \"kubernetes.io/projected/49d15505-2aa1-427d-bbb4-f57b4ed47f22-kube-api-access-rmhzt\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.056218 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.056192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:21.150929 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.150910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49d15505-2aa1-427d-bbb4-f57b4ed47f22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.151007 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.150934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d15505-2aa1-427d-bbb4-f57b4ed47f22-webhook-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.151007 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.150962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49d15505-2aa1-427d-bbb4-f57b4ed47f22-tmp\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.151007 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.150988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmhzt\" (UniqueName: \"kubernetes.io/projected/49d15505-2aa1-427d-bbb4-f57b4ed47f22-kube-api-access-rmhzt\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.151117 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.151029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49d15505-2aa1-427d-bbb4-f57b4ed47f22-manifests\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.151396 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.151352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49d15505-2aa1-427d-bbb4-f57b4ed47f22-manifests\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.153639 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.153616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49d15505-2aa1-427d-bbb4-f57b4ed47f22-tmp\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.154033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.154008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:21.154140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.154015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49d15505-2aa1-427d-bbb4-f57b4ed47f22-webhook-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.154140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.154025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49d15505-2aa1-427d-bbb4-f57b4ed47f22-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.161976 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.161944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmhzt\" (UniqueName: \"kubernetes.io/projected/49d15505-2aa1-427d-bbb4-f57b4ed47f22-kube-api-access-rmhzt\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-sqh2s\" (UID: \"49d15505-2aa1-427d-bbb4-f57b4ed47f22\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.229877 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.229850    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:21.262033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.261983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:21.386456 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.386425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:21.399597 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.399572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"]
Jul 09 18:46:21.403194 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:46:21.403166    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d15505_2aa1_427d_bbb4_f57b4ed47f22.slice/crio-ff4c77309c419da92971ee4c497d48bbe4d580edd3eb8a9a09855216d08068c5 WatchSource:0}: Error finding container ff4c77309c419da92971ee4c497d48bbe4d580edd3eb8a9a09855216d08068c5: Status 404 returned error can't find the container with id ff4c77309c419da92971ee4c497d48bbe4d580edd3eb8a9a09855216d08068c5
Jul 09 18:46:21.484101 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.484062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:21.587077 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.587015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:21.928371 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:21.928343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s" event={"ID":"49d15505-2aa1-427d-bbb4-f57b4ed47f22","Type":"ContainerStarted","Data":"ff4c77309c419da92971ee4c497d48bbe4d580edd3eb8a9a09855216d08068c5"}
Jul 09 18:46:24.945033 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:24.944993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s" event={"ID":"49d15505-2aa1-427d-bbb4-f57b4ed47f22","Type":"ContainerStarted","Data":"644884ba6e8c202c7e18999cce78f6be40ffa1a4d92ba6f9ee87c5e2c56258fa"}
Jul 09 18:46:25.951490 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:25.951457    2578 generic.go:356] "Generic (PLEG): container finished" podID="49d15505-2aa1-427d-bbb4-f57b4ed47f22" containerID="644884ba6e8c202c7e18999cce78f6be40ffa1a4d92ba6f9ee87c5e2c56258fa" exitCode=0
Jul 09 18:46:25.951894 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:25.951542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s" event={"ID":"49d15505-2aa1-427d-bbb4-f57b4ed47f22","Type":"ContainerDied","Data":"644884ba6e8c202c7e18999cce78f6be40ffa1a4d92ba6f9ee87c5e2c56258fa"}
Jul 09 18:46:26.958707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:26.958673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s" event={"ID":"49d15505-2aa1-427d-bbb4-f57b4ed47f22","Type":"ContainerStarted","Data":"1490d0079d7e0f2baa06805279d71613d7456dbb7bdc9a9dec6f771e1d425863"}
Jul 09 18:46:26.959185 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:26.958831    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:27.000630 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:27.000576    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s" podStartSLOduration=2.558023811 podStartE2EDuration="7.000556813s" totalImagesPullingTime="3.40174762s" totalInitContainerRuntime="1.040785382s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:27.000105957 +0000 UTC m=+299.808952418" watchObservedRunningTime="2026-07-09 18:46:27.000556813 +0000 UTC m=+299.809403250"
Jul 09 18:46:27.514713 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:27.514685    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:46:27.516692 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:27.516667    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:46:27.522509 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:27.522485    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:46:27.524169 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:27.524148    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:46:27.525885 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:27.525867    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 18:46:28.403225 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:28.403192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:28.523626 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:28.523590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:37.965375 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:37.965339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-sqh2s"
Jul 09 18:46:40.297088 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:40.297055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:40.399577 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:40.399544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:41.172245 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.172213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:41.272136 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.272080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:41.374235 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.374197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:41.560857 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.560775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:41.834696 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.834629    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xnvxk"]
Jul 09 18:46:41.843032 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.843012    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:41.848172 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.848153    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 18:46:41.861679 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.861649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:41.867237 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:41.867214    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xnvxk"]
Jul 09 18:46:42.012940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.012906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpdf\" (UniqueName: \"kubernetes.io/projected/ec0d3b43-4d75-4403-b077-f8ea4a08f1e7-kube-api-access-2hpdf\") pod \"model-serving-api-54d89bd5fc-xnvxk\" (UID: \"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7\") " pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.013113 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.012975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec0d3b43-4d75-4403-b077-f8ea4a08f1e7-tls-certs\") pod \"model-serving-api-54d89bd5fc-xnvxk\" (UID: \"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7\") " pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.037564 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.037528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:42.114418 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.114322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpdf\" (UniqueName: \"kubernetes.io/projected/ec0d3b43-4d75-4403-b077-f8ea4a08f1e7-kube-api-access-2hpdf\") pod \"model-serving-api-54d89bd5fc-xnvxk\" (UID: \"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7\") " pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.114418 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.114410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec0d3b43-4d75-4403-b077-f8ea4a08f1e7-tls-certs\") pod \"model-serving-api-54d89bd5fc-xnvxk\" (UID: \"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7\") " pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.116942 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.116918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec0d3b43-4d75-4403-b077-f8ea4a08f1e7-tls-certs\") pod \"model-serving-api-54d89bd5fc-xnvxk\" (UID: \"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7\") " pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.125468 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.125445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpdf\" (UniqueName: \"kubernetes.io/projected/ec0d3b43-4d75-4403-b077-f8ea4a08f1e7-kube-api-access-2hpdf\") pod \"model-serving-api-54d89bd5fc-xnvxk\" (UID: \"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7\") " pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.155025 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.154993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:42.303059 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.303034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xnvxk"]
Jul 09 18:46:42.305242 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:46:42.305214    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0d3b43_4d75_4403_b077_f8ea4a08f1e7.slice/crio-710bbb874cbe181d60ae412ccf0c28b56e82f5789a1e1fecb14019e1306550e6 WatchSource:0}: Error finding container 710bbb874cbe181d60ae412ccf0c28b56e82f5789a1e1fecb14019e1306550e6: Status 404 returned error can't find the container with id 710bbb874cbe181d60ae412ccf0c28b56e82f5789a1e1fecb14019e1306550e6
Jul 09 18:46:42.307472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.307450    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:46:42.699921 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.699879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:42.803509 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:42.803471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:43.035410 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:43.035302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk" event={"ID":"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7","Type":"ContainerStarted","Data":"710bbb874cbe181d60ae412ccf0c28b56e82f5789a1e1fecb14019e1306550e6"}
Jul 09 18:46:45.047007 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:45.046973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk" event={"ID":"ec0d3b43-4d75-4403-b077-f8ea4a08f1e7","Type":"ContainerStarted","Data":"39a40394c81e2c215991cd1b1a9b23e50d9e2cbe7f99d0cab49f4d16a93e7fb9"}
Jul 09 18:46:45.047366 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:45.047075    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:45.071225 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:45.071183    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk" podStartSLOduration=2.082551859 podStartE2EDuration="4.071172508s" totalImagesPullingTime="1.988620649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:45.070326286 +0000 UTC m=+317.879172721" watchObservedRunningTime="2026-07-09 18:46:45.071172508 +0000 UTC m=+317.880018942"
Jul 09 18:46:45.289394 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:45.289340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:47.336564 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:47.336522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:47.479861 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:47.479812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:49.510178 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.510150    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"]
Jul 09 18:46:49.513389 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.513362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.523051 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.523025    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret"
Jul 09 18:46:49.523051 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.523042    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"lws-controller-manager-dockercfg-8gfmv\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8gfmv\"" type="*v1.Secret"
Jul 09 18:46:49.523456 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.523440    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-cert\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret"
Jul 09 18:46:49.523708 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.523686    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"lws-controller-manager-68b945dcf-vjbqp\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.528857 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.528834    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"lws-manager-config\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap"
Jul 09 18:46:49.528924 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.528873    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 09 18:46:49.535836 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:49.535816    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 09 18:46:49.555051 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.555029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"]
Jul 09 18:46:49.577275 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.577255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-manager-config\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.577373 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.577283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-cert\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.577373 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.577314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-metrics-cert\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.577373 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.577368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bgh\" (UniqueName: \"kubernetes.io/projected/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-kube-api-access-27bgh\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.678334 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.678311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-manager-config\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.678452 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.678340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-cert\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.678513 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.678495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-metrics-cert\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:49.678569 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:49.678556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bgh\" (UniqueName: \"kubernetes.io/projected/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-kube-api-access-27bgh\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:50.348441 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.348405    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8gfmv\""
Jul 09 18:46:50.371311 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.371286    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 18:46:50.402844 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.402823    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 18:46:50.411181 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.411154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-cert\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:50.433445 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.433418    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 18:46:50.441058 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.441025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-metrics-cert\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:50.671919 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.671894    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:46:50.679181 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:50.679156    2578 configmap.go:193] Couldn't get configMap openshift-lws-operator/lws-manager-config: failed to sync configmap cache: timed out waiting for the condition
Jul 09 18:46:50.679277 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:46:50.679225    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-manager-config podName:2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d nodeName:}" failed. No retries permitted until 2026-07-09 18:46:51.179209614 +0000 UTC m=+323.988056027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "manager-config" (UniqueName: "kubernetes.io/configmap/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-manager-config") pod "lws-controller-manager-68b945dcf-vjbqp" (UID: "2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d") : failed to sync configmap cache: timed out waiting for the condition
Jul 09 18:46:50.682789 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.682766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bgh\" (UniqueName: \"kubernetes.io/projected/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-kube-api-access-27bgh\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:50.987905 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:50.987834    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 18:46:51.192187 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:51.192155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-manager-config\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:51.192703 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:51.192687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d-manager-config\") pod \"lws-controller-manager-68b945dcf-vjbqp\" (UID: \"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d\") " pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:51.323014 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:51.322942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:51.480160 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:51.480134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"]
Jul 09 18:46:51.481580 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:46:51.481552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2993b8fb_6c8b_4d7d_a1c7_785c1bbc640d.slice/crio-5af37aba484d008622dc3b6a6d2f79ec5d0393c2db36e2b64d34c328fe311305 WatchSource:0}: Error finding container 5af37aba484d008622dc3b6a6d2f79ec5d0393c2db36e2b64d34c328fe311305: Status 404 returned error can't find the container with id 5af37aba484d008622dc3b6a6d2f79ec5d0393c2db36e2b64d34c328fe311305
Jul 09 18:46:51.639443 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:51.639334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:51.792399 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:51.792347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:52.007345 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:52.007311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:52.082750 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:52.082721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp" event={"ID":"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d","Type":"ContainerStarted","Data":"5af37aba484d008622dc3b6a6d2f79ec5d0393c2db36e2b64d34c328fe311305"}
Jul 09 18:46:52.252187 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:52.252161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:53.059499 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:53.059458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:53.168036 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:53.167997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:53.681888 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:53.681853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:53.780906 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:53.780877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:55.066814 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:55.066778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:55.100209 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:55.100178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp" event={"ID":"2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d","Type":"ContainerStarted","Data":"3bd1c69e1099179acb4527b1920c965ad097fac4123f53d07520c49b1974411e"}
Jul 09 18:46:55.100339 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:55.100269    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:46:55.122307 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:55.122261    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp" podStartSLOduration=3.417342275 podStartE2EDuration="6.1222447s" totalImagesPullingTime="2.704902425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:55.121417403 +0000 UTC m=+327.930263837" watchObservedRunningTime="2026-07-09 18:46:55.1222447 +0000 UTC m=+327.931091135"
Jul 09 18:46:56.056667 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:56.056634    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xnvxk"
Jul 09 18:46:58.698018 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:58.697981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:58.791023 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:58.790992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:59.507083 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.507052    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"]
Jul 09 18:46:59.516793 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.516769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.520702 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.520684    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:46:59.521083 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.521065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bcbvj\""
Jul 09 18:46:59.528180 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.528160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"]
Jul 09 18:46:59.558616 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.558590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:59.560536 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560628 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560628 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ea3627-3f65-44dc-b54e-7971095e0c27-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560628 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nkxp\" (UniqueName: \"kubernetes.io/projected/80ea3627-3f65-44dc-b54e-7971095e0c27-kube-api-access-7nkxp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560751 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.560885 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.560769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.660519 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.660487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:59.661480 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nkxp\" (UniqueName: \"kubernetes.io/projected/80ea3627-3f65-44dc-b54e-7971095e0c27-kube-api-access-7nkxp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661533 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661533 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661636 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661636 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661739 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661739 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ea3627-3f65-44dc-b54e-7971095e0c27-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661739 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.661891 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.661804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.662475 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.662021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.662475 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.662049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.662475 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.662217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.662475 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.662427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.662662 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.662633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ea3627-3f65-44dc-b54e-7971095e0c27-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.664095 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.664064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.664409 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.664371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.673141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.673111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ea3627-3f65-44dc-b54e-7971095e0c27-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.673141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.673121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nkxp\" (UniqueName: \"kubernetes.io/projected/80ea3627-3f65-44dc-b54e-7971095e0c27-kube-api-access-7nkxp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44h6bt\" (UID: \"80ea3627-3f65-44dc-b54e-7971095e0c27\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.759691 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.759618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:46:59.828610 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.828578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:46:59.969405 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:46:59.969366    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"]
Jul 09 18:46:59.971416 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:46:59.971369    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ea3627_3f65_44dc_b54e_7971095e0c27.slice/crio-fdbae86245a253c6a14cd1ecd53646c0b6f96563bed006f1226e982586665185 WatchSource:0}: Error finding container fdbae86245a253c6a14cd1ecd53646c0b6f96563bed006f1226e982586665185: Status 404 returned error can't find the container with id fdbae86245a253c6a14cd1ecd53646c0b6f96563bed006f1226e982586665185
Jul 09 18:47:00.125246 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:00.125187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt" event={"ID":"80ea3627-3f65-44dc-b54e-7971095e0c27","Type":"ContainerStarted","Data":"fdbae86245a253c6a14cd1ecd53646c0b6f96563bed006f1226e982586665185"}
Jul 09 18:47:02.836532 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:02.836492    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:47:02.836898 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:02.836567    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:47:02.836898 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:02.836596    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:47:03.143881 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:03.143799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt" event={"ID":"80ea3627-3f65-44dc-b54e-7971095e0c27","Type":"ContainerStarted","Data":"a3ab522a1ed4c13ea4fca372ea308e590af57406920bb35bcb5618844cbeef1b"}
Jul 09 18:47:03.171089 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:03.171033    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt" podStartSLOduration=1.308108792 podStartE2EDuration="4.171013381s" totalImagesPullingTime="2.862904589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:03.168594474 +0000 UTC m=+335.977440909" watchObservedRunningTime="2026-07-09 18:47:03.171013381 +0000 UTC m=+335.979859816"
Jul 09 18:47:03.829446 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:03.829417    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:47:03.834426 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:03.834396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:47:04.148245 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:04.148157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:47:04.149192 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:04.149169    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44h6bt"
Jul 09 18:47:06.108160 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:06.108128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68b945dcf-vjbqp"
Jul 09 18:47:07.105878 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:07.105835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:07.178782 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:07.178745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:13.342512 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:13.342465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:41.781460 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.781348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:41.879828 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.879783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:41.936953 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.936920    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2xhm"]
Jul 09 18:47:41.949394 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.949349    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:41.955464 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.955437    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:47:41.955607 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.955491    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:47:41.957153 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.957129    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-twjdc\""
Jul 09 18:47:41.959655 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:41.959631    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2xhm"]
Jul 09 18:47:42.016370 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.016344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:42.103582 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.103519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5xxk\" (UniqueName: \"kubernetes.io/projected/32054745-339f-495b-b3b7-27d18154ab82-kube-api-access-g5xxk\") pod \"kuadrant-operator-catalog-q2xhm\" (UID: \"32054745-339f-495b-b3b7-27d18154ab82\") " pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:42.204182 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.204161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5xxk\" (UniqueName: \"kubernetes.io/projected/32054745-339f-495b-b3b7-27d18154ab82-kube-api-access-g5xxk\") pod \"kuadrant-operator-catalog-q2xhm\" (UID: \"32054745-339f-495b-b3b7-27d18154ab82\") " pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:42.215177 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.215156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5xxk\" (UniqueName: \"kubernetes.io/projected/32054745-339f-495b-b3b7-27d18154ab82-kube-api-access-g5xxk\") pod \"kuadrant-operator-catalog-q2xhm\" (UID: \"32054745-339f-495b-b3b7-27d18154ab82\") " pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:42.261237 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.261214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:42.263933 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.263910    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2xhm"]
Jul 09 18:47:42.392829 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.392812    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2xhm"]
Jul 09 18:47:42.395069 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:47:42.395041    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32054745_339f_495b_b3b7_27d18154ab82.slice/crio-bbfc8c7dfcd30b4e46ef166b8fdf045d01b5e5bea76350ed5e92ede52f65e186 WatchSource:0}: Error finding container bbfc8c7dfcd30b4e46ef166b8fdf045d01b5e5bea76350ed5e92ede52f65e186: Status 404 returned error can't find the container with id bbfc8c7dfcd30b4e46ef166b8fdf045d01b5e5bea76350ed5e92ede52f65e186
Jul 09 18:47:42.474596 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.474569    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wd6dz"]
Jul 09 18:47:42.479438 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.479422    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:42.486238 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.486217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wd6dz"]
Jul 09 18:47:42.607683 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.607658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn894\" (UniqueName: \"kubernetes.io/projected/a745a36b-96c8-4f28-8dc8-8fdc5b430092-kube-api-access-dn894\") pod \"kuadrant-operator-catalog-wd6dz\" (UID: \"a745a36b-96c8-4f28-8dc8-8fdc5b430092\") " pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:42.708609 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.708588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn894\" (UniqueName: \"kubernetes.io/projected/a745a36b-96c8-4f28-8dc8-8fdc5b430092-kube-api-access-dn894\") pod \"kuadrant-operator-catalog-wd6dz\" (UID: \"a745a36b-96c8-4f28-8dc8-8fdc5b430092\") " pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:42.720210 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.720188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn894\" (UniqueName: \"kubernetes.io/projected/a745a36b-96c8-4f28-8dc8-8fdc5b430092-kube-api-access-dn894\") pod \"kuadrant-operator-catalog-wd6dz\" (UID: \"a745a36b-96c8-4f28-8dc8-8fdc5b430092\") " pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:42.723927 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.723893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:42.790192 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.790167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:42.923929 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.923892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:47:42.937069 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:42.937044    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wd6dz"]
Jul 09 18:47:42.969129 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:47:42.969073    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda745a36b_96c8_4f28_8dc8_8fdc5b430092.slice/crio-cc72f9e37b3c961c1c48341cf1c27f6958c18c07984167106038ab351b204629 WatchSource:0}: Error finding container cc72f9e37b3c961c1c48341cf1c27f6958c18c07984167106038ab351b204629: Status 404 returned error can't find the container with id cc72f9e37b3c961c1c48341cf1c27f6958c18c07984167106038ab351b204629
Jul 09 18:47:43.343242 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:43.343172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz" event={"ID":"a745a36b-96c8-4f28-8dc8-8fdc5b430092","Type":"ContainerStarted","Data":"cc72f9e37b3c961c1c48341cf1c27f6958c18c07984167106038ab351b204629"}
Jul 09 18:47:43.344284 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:43.344256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm" event={"ID":"32054745-339f-495b-b3b7-27d18154ab82","Type":"ContainerStarted","Data":"bbfc8c7dfcd30b4e46ef166b8fdf045d01b5e5bea76350ed5e92ede52f65e186"}
Jul 09 18:47:45.356411 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.356352    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz" event={"ID":"a745a36b-96c8-4f28-8dc8-8fdc5b430092","Type":"ContainerStarted","Data":"14cc97b749e2600c4b006af8447dbf490ac04f76c2825ef1b1703104f4110394"}
Jul 09 18:47:45.358145 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.358108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm" event={"ID":"32054745-339f-495b-b3b7-27d18154ab82","Type":"ContainerStarted","Data":"6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118"}
Jul 09 18:47:45.358145 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.358131    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm" podUID="32054745-339f-495b-b3b7-27d18154ab82" containerName="registry-server" containerID="cri-o://6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118" gracePeriod=2
Jul 09 18:47:45.384818 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.384770    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz" podStartSLOduration=1.761254452 podStartE2EDuration="3.384755891s" totalImagesPullingTime="1.623501439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:45.383210584 +0000 UTC m=+378.192057030" watchObservedRunningTime="2026-07-09 18:47:45.384755891 +0000 UTC m=+378.193602326"
Jul 09 18:47:45.406323 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.406279    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm" podStartSLOduration=2.212086405 podStartE2EDuration="4.406264299s" totalImagesPullingTime="2.194177894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:47:45.405053311 +0000 UTC m=+378.213899747" watchObservedRunningTime="2026-07-09 18:47:45.406264299 +0000 UTC m=+378.215110734"
Jul 09 18:47:45.609498 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.609444    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:45.734423 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.734397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5xxk\" (UniqueName: \"kubernetes.io/projected/32054745-339f-495b-b3b7-27d18154ab82-kube-api-access-g5xxk\") pod \"32054745-339f-495b-b3b7-27d18154ab82\" (UID: \"32054745-339f-495b-b3b7-27d18154ab82\") "
Jul 09 18:47:45.736756 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.736732    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32054745-339f-495b-b3b7-27d18154ab82-kube-api-access-g5xxk" (OuterVolumeSpecName: "kube-api-access-g5xxk") pod "32054745-339f-495b-b3b7-27d18154ab82" (UID: "32054745-339f-495b-b3b7-27d18154ab82"). InnerVolumeSpecName "kube-api-access-g5xxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:47:45.835466 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:45.835441    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5xxk\" (UniqueName: \"kubernetes.io/projected/32054745-339f-495b-b3b7-27d18154ab82-kube-api-access-g5xxk\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:47:46.364766 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.364731    2578 generic.go:356] "Generic (PLEG): container finished" podID="32054745-339f-495b-b3b7-27d18154ab82" containerID="6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118" exitCode=0
Jul 09 18:47:46.365137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.364783    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm"
Jul 09 18:47:46.365137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.364828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm" event={"ID":"32054745-339f-495b-b3b7-27d18154ab82","Type":"ContainerDied","Data":"6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118"}
Jul 09 18:47:46.365137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.364882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q2xhm" event={"ID":"32054745-339f-495b-b3b7-27d18154ab82","Type":"ContainerDied","Data":"bbfc8c7dfcd30b4e46ef166b8fdf045d01b5e5bea76350ed5e92ede52f65e186"}
Jul 09 18:47:46.365137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.364906    2578 scope.go:117] "RemoveContainer" containerID="6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118"
Jul 09 18:47:46.375267 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.375249    2578 scope.go:117] "RemoveContainer" containerID="6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118"
Jul 09 18:47:46.375576 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:47:46.375549    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118\": container with ID starting with 6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118 not found: ID does not exist" containerID="6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118"
Jul 09 18:47:46.375649 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.375584    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118"} err="failed to get container status \"6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118\": rpc error: code = NotFound desc = could not find container \"6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118\": container with ID starting with 6dd09b655305be16698e9e900dcfe6c8d8c1fa1eadcef08c0a229a859a1c5118 not found: ID does not exist"
Jul 09 18:47:46.390106 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.390074    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2xhm"]
Jul 09 18:47:46.394793 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:46.394769    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q2xhm"]
Jul 09 18:47:47.646960 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:47.646907    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32054745-339f-495b-b3b7-27d18154ab82" path="/var/lib/kubelet/pods/32054745-339f-495b-b3b7-27d18154ab82/volumes"
Jul 09 18:47:52.791163 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:52.791112    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:52.791637 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:52.791207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:52.815555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:52.815532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:47:53.422623 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:47:53.422596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wd6dz"
Jul 09 18:48:06.834880 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:06.834847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:06.936472 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:06.936446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:11.023480 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:11.023443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:13.657135 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.657103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"]
Jul 09 18:48:13.657645 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.657487    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32054745-339f-495b-b3b7-27d18154ab82" containerName="registry-server"
Jul 09 18:48:13.657645 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.657498    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="32054745-339f-495b-b3b7-27d18154ab82" containerName="registry-server"
Jul 09 18:48:13.657645 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.657555    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="32054745-339f-495b-b3b7-27d18154ab82" containerName="registry-server"
Jul 09 18:48:13.663902 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.663886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:13.667492 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.667457    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gpclt\""
Jul 09 18:48:13.672987 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.672964    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"]
Jul 09 18:48:13.741704 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.741678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tct42\" (UniqueName: \"kubernetes.io/projected/30ed7855-3663-4885-b830-0e3fc4a9ee6c-kube-api-access-tct42\") pod \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" (UID: \"30ed7855-3663-4885-b830-0e3fc4a9ee6c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:13.842170 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.842139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tct42\" (UniqueName: \"kubernetes.io/projected/30ed7855-3663-4885-b830-0e3fc4a9ee6c-kube-api-access-tct42\") pod \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" (UID: \"30ed7855-3663-4885-b830-0e3fc4a9ee6c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:13.862106 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.862074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tct42\" (UniqueName: \"kubernetes.io/projected/30ed7855-3663-4885-b830-0e3fc4a9ee6c-kube-api-access-tct42\") pod \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" (UID: \"30ed7855-3663-4885-b830-0e3fc4a9ee6c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:13.974481 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:13.974457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:14.123226 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:14.123202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"]
Jul 09 18:48:14.125177 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:48:14.125152    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ed7855_3663_4885_b830_0e3fc4a9ee6c.slice/crio-3453578ce1ed03a6bff26bd0e6583e4e7d6c660192849331f96e71be14fbd038 WatchSource:0}: Error finding container 3453578ce1ed03a6bff26bd0e6583e4e7d6c660192849331f96e71be14fbd038: Status 404 returned error can't find the container with id 3453578ce1ed03a6bff26bd0e6583e4e7d6c660192849331f96e71be14fbd038
Jul 09 18:48:14.508570 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:14.508544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5" event={"ID":"30ed7855-3663-4885-b830-0e3fc4a9ee6c","Type":"ContainerStarted","Data":"3453578ce1ed03a6bff26bd0e6583e4e7d6c660192849331f96e71be14fbd038"}
Jul 09 18:48:15.248689 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:15.248643    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:16.521088 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:16.521057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5" event={"ID":"30ed7855-3663-4885-b830-0e3fc4a9ee6c","Type":"ContainerStarted","Data":"5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa"}
Jul 09 18:48:16.521467 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:16.521167    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:16.542366 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:16.542326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5" podStartSLOduration=1.6092133290000001 podStartE2EDuration="3.542312826s" totalImagesPullingTime="1.933099497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:16.54067251 +0000 UTC m=+409.349518945" watchObservedRunningTime="2026-07-09 18:48:16.542312826 +0000 UTC m=+409.351159311"
Jul 09 18:48:17.229003 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:17.228971    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"]
Jul 09 18:48:17.232508 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:17.232488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:17.237725 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:17.237685    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-operator-controller-manager-864dd78c4c-ws2rs\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="56ee312d-0aaf-41f5-92b5-f5826ade9f01" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:17.237843 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:17.237805    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-operator-controller-env\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" type="*v1.ConfigMap"
Jul 09 18:48:17.237843 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:17.237805    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-operator-controller-manager-dockercfg-mj87n\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mj87n\"" type="*v1.Secret"
Jul 09 18:48:17.273189 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:17.273168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlsbq\" (UniqueName: \"kubernetes.io/projected/56ee312d-0aaf-41f5-92b5-f5826ade9f01-kube-api-access-hlsbq\") pod \"dns-operator-controller-manager-864dd78c4c-ws2rs\" (UID: \"56ee312d-0aaf-41f5-92b5-f5826ade9f01\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:17.279216 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:17.279190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"]
Jul 09 18:48:17.374184 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:17.374158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlsbq\" (UniqueName: \"kubernetes.io/projected/56ee312d-0aaf-41f5-92b5-f5826ade9f01-kube-api-access-hlsbq\") pod \"dns-operator-controller-manager-864dd78c4c-ws2rs\" (UID: \"56ee312d-0aaf-41f5-92b5-f5826ade9f01\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:17.424926 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:17.424895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlsbq\" (UniqueName: \"kubernetes.io/projected/56ee312d-0aaf-41f5-92b5-f5826ade9f01-kube-api-access-hlsbq\") pod \"dns-operator-controller-manager-864dd78c4c-ws2rs\" (UID: \"56ee312d-0aaf-41f5-92b5-f5826ade9f01\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:18.286002 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.285969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:18.445539 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.445504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:18.545284 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.545226    2578 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Jul 09 18:48:18.545421 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.545296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:18.564337 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.564311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:18.713368 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.713342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"]
Jul 09 18:48:18.716057 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:48:18.716025    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ee312d_0aaf_41f5_92b5_f5826ade9f01.slice/crio-b65143e30f7bd308fc683fdb18fd016c82ff1c94565e95e43852dcea7d872251 WatchSource:0}: Error finding container b65143e30f7bd308fc683fdb18fd016c82ff1c94565e95e43852dcea7d872251: Status 404 returned error can't find the container with id b65143e30f7bd308fc683fdb18fd016c82ff1c94565e95e43852dcea7d872251
Jul 09 18:48:18.766589 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.766573    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mj87n\""
Jul 09 18:48:18.783618 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:18.783596    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 18:48:19.186509 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:19.186485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:19.536428 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:19.536341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs" event={"ID":"56ee312d-0aaf-41f5-92b5-f5826ade9f01","Type":"ContainerStarted","Data":"b65143e30f7bd308fc683fdb18fd016c82ff1c94565e95e43852dcea7d872251"}
Jul 09 18:48:20.499439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:20.499363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:21.547631 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:21.547601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs" event={"ID":"56ee312d-0aaf-41f5-92b5-f5826ade9f01","Type":"ContainerStarted","Data":"38d0b53e2b8149efe2923b0e5068b42ab6c612507f985d5239d6e6e223be2805"}
Jul 09 18:48:21.547888 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:21.547743    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:21.571494 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:21.571451    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs" podStartSLOduration=1.823464114 podStartE2EDuration="4.571437089s" totalImagesPullingTime="2.747972975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:21.569393642 +0000 UTC m=+414.378240068" watchObservedRunningTime="2026-07-09 18:48:21.571437089 +0000 UTC m=+414.380283524"
Jul 09 18:48:22.246499 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:22.246461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:23.222005 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:23.221974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:23.858260 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:23.858217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:24.891866 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:24.891803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:26.535013 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.534982    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"]
Jul 09 18:48:26.538633 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.538612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:26.542146 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.542115    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dwrww\""
Jul 09 18:48:26.553250 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.553228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"]
Jul 09 18:48:26.650235 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.650206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2595c\" (UniqueName: \"kubernetes.io/projected/876ce1db-6cb1-417b-8a67-0418c8c4101f-kube-api-access-2595c\") pod \"authorino-operator-75cc8d5cb7-t6prl\" (UID: \"876ce1db-6cb1-417b-8a67-0418c8c4101f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:26.751482 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.751454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2595c\" (UniqueName: \"kubernetes.io/projected/876ce1db-6cb1-417b-8a67-0418c8c4101f-kube-api-access-2595c\") pod \"authorino-operator-75cc8d5cb7-t6prl\" (UID: \"876ce1db-6cb1-417b-8a67-0418c8c4101f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:26.763168 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.763137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2595c\" (UniqueName: \"kubernetes.io/projected/876ce1db-6cb1-417b-8a67-0418c8c4101f-kube-api-access-2595c\") pod \"authorino-operator-75cc8d5cb7-t6prl\" (UID: \"876ce1db-6cb1-417b-8a67-0418c8c4101f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:26.849170 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.849105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:26.999125 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:26.999099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"]
Jul 09 18:48:27.000044 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:48:27.000014    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876ce1db_6cb1_417b_8a67_0418c8c4101f.slice/crio-622327f0862ac8e77218b3f1df06b1f2f84915b2dbaf2702079e256741d1bea3 WatchSource:0}: Error finding container 622327f0862ac8e77218b3f1df06b1f2f84915b2dbaf2702079e256741d1bea3: Status 404 returned error can't find the container with id 622327f0862ac8e77218b3f1df06b1f2f84915b2dbaf2702079e256741d1bea3
Jul 09 18:48:27.528034 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:27.528010    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:27.581163 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:27.581136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl" event={"ID":"876ce1db-6cb1-417b-8a67-0418c8c4101f","Type":"ContainerStarted","Data":"622327f0862ac8e77218b3f1df06b1f2f84915b2dbaf2702079e256741d1bea3"}
Jul 09 18:48:27.855103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:27.855018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:28.058626 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:28.058596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:29.593370 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:29.593325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl" event={"ID":"876ce1db-6cb1-417b-8a67-0418c8c4101f","Type":"ContainerStarted","Data":"d0e23c2ee7043c13b26a22919e52a1280b0af05a28e2ab9b3a611e822f753751"}
Jul 09 18:48:29.593786 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:29.593477    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:29.613096 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:29.613056    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl" podStartSLOduration=1.579358635 podStartE2EDuration="3.613042985s" totalImagesPullingTime="2.03368435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:29.612786103 +0000 UTC m=+422.421632538" watchObservedRunningTime="2026-07-09 18:48:29.613042985 +0000 UTC m=+422.421889419"
Jul 09 18:48:30.233739 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:30.233706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:30.299525 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:30.299500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:32.555952 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:32.555915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ws2rs"
Jul 09 18:48:33.828901 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.828867    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"]
Jul 09 18:48:33.832514 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.832496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:33.836125 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.836100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 18:48:33.836237 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.836137    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wdsc\""
Jul 09 18:48:33.836551 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.836534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 18:48:33.846731 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.846709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"]
Jul 09 18:48:33.855729 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.855705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:33.909894 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.909873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d6add7-6add-487e-a245-335868d5b44e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:33.909981 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.909901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24d6add7-6add-487e-a245-335868d5b44e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:33.909981 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:33.909942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg5gw\" (UniqueName: \"kubernetes.io/projected/24d6add7-6add-487e-a245-335868d5b44e-kube-api-access-rg5gw\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.011064 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.011041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg5gw\" (UniqueName: \"kubernetes.io/projected/24d6add7-6add-487e-a245-335868d5b44e-kube-api-access-rg5gw\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.011156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.011106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d6add7-6add-487e-a245-335868d5b44e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.011156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.011133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24d6add7-6add-487e-a245-335868d5b44e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.011274 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:34.011255    2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 18:48:34.011340 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:34.011330    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d6add7-6add-487e-a245-335868d5b44e-plugin-serving-cert podName:24d6add7-6add-487e-a245-335868d5b44e nodeName:}" failed. No retries permitted until 2026-07-09 18:48:34.511314594 +0000 UTC m=+427.320161006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/24d6add7-6add-487e-a245-335868d5b44e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-8gjrc" (UID: "24d6add7-6add-487e-a245-335868d5b44e") : secret "plugin-serving-cert" not found
Jul 09 18:48:34.011780 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.011762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24d6add7-6add-487e-a245-335868d5b44e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.025296 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.025270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg5gw\" (UniqueName: \"kubernetes.io/projected/24d6add7-6add-487e-a245-335868d5b44e-kube-api-access-rg5gw\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.515871 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.515840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d6add7-6add-487e-a245-335868d5b44e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.518498 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.518477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d6add7-6add-487e-a245-335868d5b44e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8gjrc\" (UID: \"24d6add7-6add-487e-a245-335868d5b44e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.550816 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.550785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:34.742421 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.742352    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"
Jul 09 18:48:34.846942 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.846908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:34.884610 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.884585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc"]
Jul 09 18:48:34.886970 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:48:34.886947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24d6add7_6add_487e_a245_335868d5b44e.slice/crio-abd37fecbccbd114ab88bc4fab72ba321ac8c0a595ccb1c1e710d7a07486bdf3 WatchSource:0}: Error finding container abd37fecbccbd114ab88bc4fab72ba321ac8c0a595ccb1c1e710d7a07486bdf3: Status 404 returned error can't find the container with id abd37fecbccbd114ab88bc4fab72ba321ac8c0a595ccb1c1e710d7a07486bdf3
Jul 09 18:48:34.943662 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:34.943636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:35.628063 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:35.628018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc" event={"ID":"24d6add7-6add-487e-a245-335868d5b44e","Type":"ContainerStarted","Data":"abd37fecbccbd114ab88bc4fab72ba321ac8c0a595ccb1c1e710d7a07486bdf3"}
Jul 09 18:48:36.718560 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:36.718516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:40.600203 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:40.600172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t6prl"
Jul 09 18:48:43.326836 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.326804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:43.426574 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.426043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:43.803725 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.803608    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"]
Jul 09 18:48:43.803927 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.803841    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" containerName="manager" containerID="cri-o://5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa" gracePeriod=2
Jul 09 18:48:43.806856 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.806783    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"]
Jul 09 18:48:43.807741 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:43.807703    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:43.825992 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.825965    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"]
Jul 09 18:48:43.826555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.826538    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" containerName="manager"
Jul 09 18:48:43.826555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.826557    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" containerName="manager"
Jul 09 18:48:43.826712 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.826664    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" containerName="manager"
Jul 09 18:48:43.830089 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.830060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:43.835626 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.835596    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5ncwd\""
Jul 09 18:48:43.835732 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:43.835634    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:43.860103 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.860030    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"]
Jul 09 18:48:43.999603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.999569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5bj2\" (UniqueName: \"kubernetes.io/projected/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-kube-api-access-m5bj2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vd6fb\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:43.999785 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:43.999619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vd6fb\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:44.100854 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:44.100772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5bj2\" (UniqueName: \"kubernetes.io/projected/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-kube-api-access-m5bj2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vd6fb\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:44.100854 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:44.100822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vd6fb\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:44.101315 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:44.101288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vd6fb\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:44.124224 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:44.124203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5bj2\" (UniqueName: \"kubernetes.io/projected/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-kube-api-access-m5bj2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vd6fb\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:44.182170 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:44.182142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:48:46.161808 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:46.161767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:46.277022 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:46.276973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:48.743913 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:48.743823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:48.846886 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:48.846815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:52.958226 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:52.958147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:53.113909 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:53.113872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:56.164635 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:56.164578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:48:56.193646 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:56.193617    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"]
Jul 09 18:48:57.189333 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.189311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:57.194849 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:57.194815    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:57.196232 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.196207    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"]
Jul 09 18:48:57.198924 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:48:57.198899    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d6440b_29bd_4bd1_af00_94c98b5ebfd9.slice/crio-62ddf5e9447df2bf5a83e92bfdfc2874005c76f16d4f52e7c9cbd46cbb2df1ce WatchSource:0}: Error finding container 62ddf5e9447df2bf5a83e92bfdfc2874005c76f16d4f52e7c9cbd46cbb2df1ce: Status 404 returned error can't find the container with id 62ddf5e9447df2bf5a83e92bfdfc2874005c76f16d4f52e7c9cbd46cbb2df1ce
Jul 09 18:48:57.223468 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.223449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tct42\" (UniqueName: \"kubernetes.io/projected/30ed7855-3663-4885-b830-0e3fc4a9ee6c-kube-api-access-tct42\") pod \"30ed7855-3663-4885-b830-0e3fc4a9ee6c\" (UID: \"30ed7855-3663-4885-b830-0e3fc4a9ee6c\") "
Jul 09 18:48:57.225525 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.225489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ed7855-3663-4885-b830-0e3fc4a9ee6c-kube-api-access-tct42" (OuterVolumeSpecName: "kube-api-access-tct42") pod "30ed7855-3663-4885-b830-0e3fc4a9ee6c" (UID: "30ed7855-3663-4885-b830-0e3fc4a9ee6c"). InnerVolumeSpecName "kube-api-access-tct42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:57.324778 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.324731    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tct42\" (UniqueName: \"kubernetes.io/projected/30ed7855-3663-4885-b830-0e3fc4a9ee6c-kube-api-access-tct42\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:48:57.639288 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:57.639199    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:57.642415 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.642368    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" path="/var/lib/kubelet/pods/30ed7855-3663-4885-b830-0e3fc4a9ee6c/volumes"
Jul 09 18:48:57.750555 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.750528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb" event={"ID":"58d6440b-29bd-4bd1-af00-94c98b5ebfd9","Type":"ContainerStarted","Data":"62ddf5e9447df2bf5a83e92bfdfc2874005c76f16d4f52e7c9cbd46cbb2df1ce"}
Jul 09 18:48:57.751869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.751848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc" event={"ID":"24d6add7-6add-487e-a245-335868d5b44e","Type":"ContainerStarted","Data":"3aedee9432e2a468b77af7c82b6afc68d868e4558192f134951cff9cf0f337de"}
Jul 09 18:48:57.753028 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.753009    2578 generic.go:356] "Generic (PLEG): container finished" podID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" containerID="5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa" exitCode=0
Jul 09 18:48:57.753110 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.753044    2578 scope.go:117] "RemoveContainer" containerID="5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa"
Jul 09 18:48:57.753110 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.753062    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:48:57.761550 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.761529    2578 scope.go:117] "RemoveContainer" containerID="5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa"
Jul 09 18:48:57.761820 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:57.761792    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa\": container with ID starting with 5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa not found: ID does not exist" containerID="5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa"
Jul 09 18:48:57.761905 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.761831    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa"} err="failed to get container status \"5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa\": rpc error: code = NotFound desc = could not find container \"5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa\": container with ID starting with 5d941753123e9ee33a51f488ce7551b8b552b0de4638da34af30541cc12c0baa not found: ID does not exist"
Jul 09 18:48:57.774503 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:48:57.774466    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8gjrc" podStartSLOduration=2.528250336 podStartE2EDuration="24.774452687s" totalImagesPullingTime="22.246202351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:57.773893375 +0000 UTC m=+450.582739810" watchObservedRunningTime="2026-07-09 18:48:57.774452687 +0000 UTC m=+450.583299121"
Jul 09 18:48:57.777554 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:48:57.777532    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lwjn5\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="30ed7855-3663-4885-b830-0e3fc4a9ee6c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lwjn5"
Jul 09 18:49:00.732712 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:00.732677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:00.817341 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:00.817311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:01.434291 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:01.434257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:01.531410 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:01.531353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:02.782924 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:02.782891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb" event={"ID":"58d6440b-29bd-4bd1-af00-94c98b5ebfd9","Type":"ContainerStarted","Data":"b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da"}
Jul 09 18:49:02.782924 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:02.782907    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb" podUID="58d6440b-29bd-4bd1-af00-94c98b5ebfd9" containerName="manager" containerID="cri-o://b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da" gracePeriod=10
Jul 09 18:49:02.783314 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:02.782954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:49:02.808329 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:02.808227    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb" podStartSLOduration=14.452196552 podStartE2EDuration="19.808206834s" totalImagesPullingTime="5.356010282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:49:02.806464409 +0000 UTC m=+455.615310846" watchObservedRunningTime="2026-07-09 18:49:02.808206834 +0000 UTC m=+455.617053253"
Jul 09 18:49:03.028308 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.028282    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:49:03.074603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.074539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5bj2\" (UniqueName: \"kubernetes.io/projected/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-kube-api-access-m5bj2\") pod \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") "
Jul 09 18:49:03.074732 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.074654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-extensions-socket-volume\") pod \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\" (UID: \"58d6440b-29bd-4bd1-af00-94c98b5ebfd9\") "
Jul 09 18:49:03.074897 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.074870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "58d6440b-29bd-4bd1-af00-94c98b5ebfd9" (UID: "58d6440b-29bd-4bd1-af00-94c98b5ebfd9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:49:03.074987 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.074975    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-extensions-socket-volume\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:49:03.076785 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.076766    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-kube-api-access-m5bj2" (OuterVolumeSpecName: "kube-api-access-m5bj2") pod "58d6440b-29bd-4bd1-af00-94c98b5ebfd9" (UID: "58d6440b-29bd-4bd1-af00-94c98b5ebfd9"). InnerVolumeSpecName "kube-api-access-m5bj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:49:03.176120 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.175835    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5bj2\" (UniqueName: \"kubernetes.io/projected/58d6440b-29bd-4bd1-af00-94c98b5ebfd9-kube-api-access-m5bj2\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:49:03.789137 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.789105    2578 generic.go:356] "Generic (PLEG): container finished" podID="58d6440b-29bd-4bd1-af00-94c98b5ebfd9" containerID="b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da" exitCode=2
Jul 09 18:49:03.789487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.789155    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"
Jul 09 18:49:03.789487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.789196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb" event={"ID":"58d6440b-29bd-4bd1-af00-94c98b5ebfd9","Type":"ContainerDied","Data":"b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da"}
Jul 09 18:49:03.789487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.789252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb" event={"ID":"58d6440b-29bd-4bd1-af00-94c98b5ebfd9","Type":"ContainerDied","Data":"62ddf5e9447df2bf5a83e92bfdfc2874005c76f16d4f52e7c9cbd46cbb2df1ce"}
Jul 09 18:49:03.789487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.789276    2578 scope.go:117] "RemoveContainer" containerID="b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da"
Jul 09 18:49:03.798369 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.798347    2578 scope.go:117] "RemoveContainer" containerID="b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da"
Jul 09 18:49:03.798715 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:49:03.798694    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da\": container with ID starting with b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da not found: ID does not exist" containerID="b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da"
Jul 09 18:49:03.798813 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.798720    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da"} err="failed to get container status \"b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da\": rpc error: code = NotFound desc = could not find container \"b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da\": container with ID starting with b493d61377166b9389187da5ae4b0edb7db42c2cf2de34825b5ef379af0b86da not found: ID does not exist"
Jul 09 18:49:03.829627 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.829601    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"]
Jul 09 18:49:03.832794 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:03.832774    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vd6fb"]
Jul 09 18:49:05.640288 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:05.640249    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58d6440b-29bd-4bd1-af00-94c98b5ebfd9" path="/var/lib/kubelet/pods/58d6440b-29bd-4bd1-af00-94c98b5ebfd9/volumes"
Jul 09 18:49:12.626018 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.625981    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"]
Jul 09 18:49:12.626643 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.626618    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d6440b-29bd-4bd1-af00-94c98b5ebfd9" containerName="manager"
Jul 09 18:49:12.626643 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.626644    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d6440b-29bd-4bd1-af00-94c98b5ebfd9" containerName="manager"
Jul 09 18:49:12.626873 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.626742    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d6440b-29bd-4bd1-af00-94c98b5ebfd9" containerName="manager"
Jul 09 18:49:12.646198 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.646170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.649457 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.649430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"]
Jul 09 18:49:12.649930 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.649910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-s6t6m\""
Jul 09 18:49:12.677269 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.677250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:12.749687 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.749660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.749797 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.749719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.749797 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.749777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.749908 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.749869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.750017 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.749992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4c8n\" (UniqueName: \"kubernetes.io/projected/5768b918-c6ad-4dbf-9c94-26a87992d1ca-kube-api-access-x4c8n\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.750100 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.750077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.750162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.750143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.750203 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.750172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.750259 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.750239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851310 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851452 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851452 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4c8n\" (UniqueName: \"kubernetes.io/projected/5768b918-c6ad-4dbf-9c94-26a87992d1ca-kube-api-access-x4c8n\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851452 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851757 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851757 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851757 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851918 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.851918 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.852019 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.851999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.852258 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.852197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.853727 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.853709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.854082 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.854062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.863028 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.863000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5768b918-c6ad-4dbf-9c94-26a87992d1ca-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.863474 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.863458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4c8n\" (UniqueName: \"kubernetes.io/projected/5768b918-c6ad-4dbf-9c94-26a87992d1ca-kube-api-access-x4c8n\") pod \"maas-default-gateway-openshift-default-56654dcf7-xbnnl\" (UID: \"5768b918-c6ad-4dbf-9c94-26a87992d1ca\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:12.876761 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.876708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:12.959025 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:12.959007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:13.097727 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.097700    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"]
Jul 09 18:49:13.099110 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:49:13.099083    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5768b918_c6ad_4dbf_9c94_26a87992d1ca.slice/crio-c658fbcf36be7fe66006c9739a9b2b5eebe90e267eadb40008b92105b717d477 WatchSource:0}: Error finding container c658fbcf36be7fe66006c9739a9b2b5eebe90e267eadb40008b92105b717d477: Status 404 returned error can't find the container with id c658fbcf36be7fe66006c9739a9b2b5eebe90e267eadb40008b92105b717d477
Jul 09 18:49:13.101454 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.101419    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:49:13.101529 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.101497    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:49:13.101562 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.101526    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:49:13.843056 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.843022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" event={"ID":"5768b918-c6ad-4dbf-9c94-26a87992d1ca","Type":"ContainerStarted","Data":"fc9a3220df8fd499845e09983c33bc9d527de63e2399c0d16a94fc235d318564"}
Jul 09 18:49:13.843549 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.843073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" event={"ID":"5768b918-c6ad-4dbf-9c94-26a87992d1ca","Type":"ContainerStarted","Data":"c658fbcf36be7fe66006c9739a9b2b5eebe90e267eadb40008b92105b717d477"}
Jul 09 18:49:13.873580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.873521    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" podStartSLOduration=1.873501959 podStartE2EDuration="1.873501959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:49:13.869929995 +0000 UTC m=+466.678776430" watchObservedRunningTime="2026-07-09 18:49:13.873501959 +0000 UTC m=+466.682348406"
Jul 09 18:49:13.959622 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:13.959597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:14.965515 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:14.965479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:15.852750 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:15.852717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:15.853745 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:15.853728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:49:26.605605 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:26.605571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:26.712133 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:26.712099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:26.817000 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:26.816966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:27.083588 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.083557    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:49:27.217084 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.217056    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:49:27.217084 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.217100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:49:27.217273 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.217163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.221184 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.221163    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 18:49:27.363672 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.363618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdq8m\" (UniqueName: \"kubernetes.io/projected/e2163f62-1526-4999-a45b-c4eebbcfb55c-kube-api-access-sdq8m\") pod \"limitador-limitador-54d6d988d5-tpsrn\" (UID: \"e2163f62-1526-4999-a45b-c4eebbcfb55c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.363672 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.363659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2163f62-1526-4999-a45b-c4eebbcfb55c-config-file\") pod \"limitador-limitador-54d6d988d5-tpsrn\" (UID: \"e2163f62-1526-4999-a45b-c4eebbcfb55c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.464818 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.464786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdq8m\" (UniqueName: \"kubernetes.io/projected/e2163f62-1526-4999-a45b-c4eebbcfb55c-kube-api-access-sdq8m\") pod \"limitador-limitador-54d6d988d5-tpsrn\" (UID: \"e2163f62-1526-4999-a45b-c4eebbcfb55c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.464959 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.464838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2163f62-1526-4999-a45b-c4eebbcfb55c-config-file\") pod \"limitador-limitador-54d6d988d5-tpsrn\" (UID: \"e2163f62-1526-4999-a45b-c4eebbcfb55c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.465540 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.465518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2163f62-1526-4999-a45b-c4eebbcfb55c-config-file\") pod \"limitador-limitador-54d6d988d5-tpsrn\" (UID: \"e2163f62-1526-4999-a45b-c4eebbcfb55c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.478352 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.478330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdq8m\" (UniqueName: \"kubernetes.io/projected/e2163f62-1526-4999-a45b-c4eebbcfb55c-kube-api-access-sdq8m\") pod \"limitador-limitador-54d6d988d5-tpsrn\" (UID: \"e2163f62-1526-4999-a45b-c4eebbcfb55c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.528027 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.528009    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:27.566648 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.566622    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8w5bn"]
Jul 09 18:49:27.577501 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.577479    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:27.578904 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.578883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8w5bn"]
Jul 09 18:49:27.581309 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.581255    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xp8dl\""
Jul 09 18:49:27.608122 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.608094    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:27.666709 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.666681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wml59\" (UniqueName: \"kubernetes.io/projected/3628fc71-e48c-4448-93bd-092027dbac58-kube-api-access-wml59\") pod \"authorino-58cd955675-8w5bn\" (UID: \"3628fc71-e48c-4448-93bd-092027dbac58\") " pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:27.685459 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.685420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:27.693274 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.693252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:49:27.695801 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:49:27.695776    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2163f62_1526_4999_a45b_c4eebbcfb55c.slice/crio-0ab91574be35051e5bf15b167516cf3d75e961dc4b3416369adb5c319bd84628 WatchSource:0}: Error finding container 0ab91574be35051e5bf15b167516cf3d75e961dc4b3416369adb5c319bd84628: Status 404 returned error can't find the container with id 0ab91574be35051e5bf15b167516cf3d75e961dc4b3416369adb5c319bd84628
Jul 09 18:49:27.767692 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.767660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wml59\" (UniqueName: \"kubernetes.io/projected/3628fc71-e48c-4448-93bd-092027dbac58-kube-api-access-wml59\") pod \"authorino-58cd955675-8w5bn\" (UID: \"3628fc71-e48c-4448-93bd-092027dbac58\") " pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:27.779426 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.779406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wml59\" (UniqueName: \"kubernetes.io/projected/3628fc71-e48c-4448-93bd-092027dbac58-kube-api-access-wml59\") pod \"authorino-58cd955675-8w5bn\" (UID: \"3628fc71-e48c-4448-93bd-092027dbac58\") " pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:27.888838 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.888817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:27.913192 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:27.913131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn" event={"ID":"e2163f62-1526-4999-a45b-c4eebbcfb55c","Type":"ContainerStarted","Data":"0ab91574be35051e5bf15b167516cf3d75e961dc4b3416369adb5c319bd84628"}
Jul 09 18:49:28.043912 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:28.043863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8w5bn"]
Jul 09 18:49:28.046158 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:49:28.046133    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3628fc71_e48c_4448_93bd_092027dbac58.slice/crio-0bf1c8848c60f453803ee955ff237177d4bf9ab78b864a64efaa1aeb62efc48c WatchSource:0}: Error finding container 0bf1c8848c60f453803ee955ff237177d4bf9ab78b864a64efaa1aeb62efc48c: Status 404 returned error can't find the container with id 0bf1c8848c60f453803ee955ff237177d4bf9ab78b864a64efaa1aeb62efc48c
Jul 09 18:49:28.920049 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:28.920012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8w5bn" event={"ID":"3628fc71-e48c-4448-93bd-092027dbac58","Type":"ContainerStarted","Data":"0bf1c8848c60f453803ee955ff237177d4bf9ab78b864a64efaa1aeb62efc48c"}
Jul 09 18:49:32.111979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.111927    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8w5bn"]
Jul 09 18:49:32.944866 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.944828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8w5bn" event={"ID":"3628fc71-e48c-4448-93bd-092027dbac58","Type":"ContainerStarted","Data":"14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4"}
Jul 09 18:49:32.945013 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.944896    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8w5bn" podUID="3628fc71-e48c-4448-93bd-092027dbac58" containerName="authorino" containerID="cri-o://14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4" gracePeriod=30
Jul 09 18:49:32.946649 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.946618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn" event={"ID":"e2163f62-1526-4999-a45b-c4eebbcfb55c","Type":"ContainerStarted","Data":"7e13d8ab5286152f2799d8c8033044f72803cc3ff45c91b893914806a0d31692"}
Jul 09 18:49:32.946749 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.946701    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:32.964188 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.964149    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8w5bn" podStartSLOduration=1.467625283 podStartE2EDuration="5.964133693s" totalImagesPullingTime="4.49650841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:49:32.962315198 +0000 UTC m=+485.771161644" watchObservedRunningTime="2026-07-09 18:49:32.964133693 +0000 UTC m=+485.772980127"
Jul 09 18:49:32.984284 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:32.984237    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn" podStartSLOduration=1.149274013 podStartE2EDuration="5.98422415s" totalImagesPullingTime="4.834950137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:49:32.982580955 +0000 UTC m=+485.791427390" watchObservedRunningTime="2026-07-09 18:49:32.98422415 +0000 UTC m=+485.793070585"
Jul 09 18:49:33.200008 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.199957    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:33.324436 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.324414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wml59\" (UniqueName: \"kubernetes.io/projected/3628fc71-e48c-4448-93bd-092027dbac58-kube-api-access-wml59\") pod \"3628fc71-e48c-4448-93bd-092027dbac58\" (UID: \"3628fc71-e48c-4448-93bd-092027dbac58\") "
Jul 09 18:49:33.326634 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.326608    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3628fc71-e48c-4448-93bd-092027dbac58-kube-api-access-wml59" (OuterVolumeSpecName: "kube-api-access-wml59") pod "3628fc71-e48c-4448-93bd-092027dbac58" (UID: "3628fc71-e48c-4448-93bd-092027dbac58"). InnerVolumeSpecName "kube-api-access-wml59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:49:33.425394 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.425359    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wml59\" (UniqueName: \"kubernetes.io/projected/3628fc71-e48c-4448-93bd-092027dbac58-kube-api-access-wml59\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:49:33.952820 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.952791    2578 generic.go:356] "Generic (PLEG): container finished" podID="3628fc71-e48c-4448-93bd-092027dbac58" containerID="14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4" exitCode=0
Jul 09 18:49:33.952959 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.952836    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8w5bn"
Jul 09 18:49:33.952959 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.952887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8w5bn" event={"ID":"3628fc71-e48c-4448-93bd-092027dbac58","Type":"ContainerDied","Data":"14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4"}
Jul 09 18:49:33.952959 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.952939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8w5bn" event={"ID":"3628fc71-e48c-4448-93bd-092027dbac58","Type":"ContainerDied","Data":"0bf1c8848c60f453803ee955ff237177d4bf9ab78b864a64efaa1aeb62efc48c"}
Jul 09 18:49:33.953115 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.952971    2578 scope.go:117] "RemoveContainer" containerID="14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4"
Jul 09 18:49:33.962582 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.962556    2578 scope.go:117] "RemoveContainer" containerID="14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4"
Jul 09 18:49:33.962940 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:49:33.962912    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4\": container with ID starting with 14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4 not found: ID does not exist" containerID="14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4"
Jul 09 18:49:33.963062 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.962944    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4"} err="failed to get container status \"14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4\": rpc error: code = NotFound desc = could not find container \"14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4\": container with ID starting with 14b13719e5d40910dae545ce8947044812dfbcc8385e1796e6fa2f94e28cd1d4 not found: ID does not exist"
Jul 09 18:49:33.976517 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.976493    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8w5bn"]
Jul 09 18:49:33.989442 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:33.989420    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8w5bn"]
Jul 09 18:49:35.640188 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:35.640152    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3628fc71-e48c-4448-93bd-092027dbac58" path="/var/lib/kubelet/pods/3628fc71-e48c-4448-93bd-092027dbac58/volumes"
Jul 09 18:49:43.954212 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:43.954177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"
Jul 09 18:49:46.430182 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:46.430134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:46.530037 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:46.530005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:46.952124 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:46.952086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:59.595865 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.595789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:59.701474 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.701406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:49:59.776850 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.776819    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9xg5s"]
Jul 09 18:49:59.777259 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.777242    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3628fc71-e48c-4448-93bd-092027dbac58" containerName="authorino"
Jul 09 18:49:59.777346 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.777263    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3628fc71-e48c-4448-93bd-092027dbac58" containerName="authorino"
Jul 09 18:49:59.777427 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.777362    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3628fc71-e48c-4448-93bd-092027dbac58" containerName="authorino"
Jul 09 18:49:59.780410 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.780366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:49:59.783687 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.783671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xp8dl\""
Jul 09 18:49:59.791124 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.791105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9xg5s"]
Jul 09 18:49:59.831763 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.831743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlwk\" (UniqueName: \"kubernetes.io/projected/4b241041-a0b0-4f65-9838-d4f11981512f-kube-api-access-2nlwk\") pod \"authorino-5d4b67c446-9xg5s\" (UID: \"4b241041-a0b0-4f65-9838-d4f11981512f\") " pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:49:59.932261 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.932237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlwk\" (UniqueName: \"kubernetes.io/projected/4b241041-a0b0-4f65-9838-d4f11981512f-kube-api-access-2nlwk\") pod \"authorino-5d4b67c446-9xg5s\" (UID: \"4b241041-a0b0-4f65-9838-d4f11981512f\") " pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:49:59.943787 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:49:59.943764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlwk\" (UniqueName: \"kubernetes.io/projected/4b241041-a0b0-4f65-9838-d4f11981512f-kube-api-access-2nlwk\") pod \"authorino-5d4b67c446-9xg5s\" (UID: \"4b241041-a0b0-4f65-9838-d4f11981512f\") " pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:50:00.018386 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.018359    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9xg5s"]
Jul 09 18:50:00.018579 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.018568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:50:00.051402 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.051358    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fb6996b99-lq9tg"]
Jul 09 18:50:00.055831 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.055814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:00.062916 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.062888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fb6996b99-lq9tg"]
Jul 09 18:50:00.134323 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.134293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhlx\" (UniqueName: \"kubernetes.io/projected/d5902a8a-d4b2-40eb-bf20-a0069e881a45-kube-api-access-thhlx\") pod \"authorino-7fb6996b99-lq9tg\" (UID: \"d5902a8a-d4b2-40eb-bf20-a0069e881a45\") " pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:00.162812 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.162786    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fb6996b99-lq9tg"]
Jul 09 18:50:00.163102 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:50:00.163080    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-thhlx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7fb6996b99-lq9tg" podUID="d5902a8a-d4b2-40eb-bf20-a0069e881a45"
Jul 09 18:50:00.164766 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.164745    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9xg5s"]
Jul 09 18:50:00.166393 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:50:00.166345    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b241041_a0b0_4f65_9838_d4f11981512f.slice/crio-7a3433d24de4e580d108901029829835115a83f7706ef2f6af2f817efe8b7c03 WatchSource:0}: Error finding container 7a3433d24de4e580d108901029829835115a83f7706ef2f6af2f817efe8b7c03: Status 404 returned error can't find the container with id 7a3433d24de4e580d108901029829835115a83f7706ef2f6af2f817efe8b7c03
Jul 09 18:50:00.199029 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.198980    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8557fdb67f-jv7rk"]
Jul 09 18:50:00.202610 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.202594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.205936 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.205917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 18:50:00.211323 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.211294    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8557fdb67f-jv7rk"]
Jul 09 18:50:00.234967 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.234947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thhlx\" (UniqueName: \"kubernetes.io/projected/d5902a8a-d4b2-40eb-bf20-a0069e881a45-kube-api-access-thhlx\") pod \"authorino-7fb6996b99-lq9tg\" (UID: \"d5902a8a-d4b2-40eb-bf20-a0069e881a45\") " pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:00.235063 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.235037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01940c56-46d8-4b97-acde-50087ebf0cc3-tls-cert\") pod \"authorino-8557fdb67f-jv7rk\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") " pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.235063 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.235058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7qgr\" (UniqueName: \"kubernetes.io/projected/01940c56-46d8-4b97-acde-50087ebf0cc3-kube-api-access-m7qgr\") pod \"authorino-8557fdb67f-jv7rk\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") " pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.245427 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.245408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhlx\" (UniqueName: \"kubernetes.io/projected/d5902a8a-d4b2-40eb-bf20-a0069e881a45-kube-api-access-thhlx\") pod \"authorino-7fb6996b99-lq9tg\" (UID: \"d5902a8a-d4b2-40eb-bf20-a0069e881a45\") " pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:00.336221 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.336197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01940c56-46d8-4b97-acde-50087ebf0cc3-tls-cert\") pod \"authorino-8557fdb67f-jv7rk\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") " pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.336310 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.336227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7qgr\" (UniqueName: \"kubernetes.io/projected/01940c56-46d8-4b97-acde-50087ebf0cc3-kube-api-access-m7qgr\") pod \"authorino-8557fdb67f-jv7rk\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") " pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.338624 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.338606    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01940c56-46d8-4b97-acde-50087ebf0cc3-tls-cert\") pod \"authorino-8557fdb67f-jv7rk\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") " pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.347458 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.347442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7qgr\" (UniqueName: \"kubernetes.io/projected/01940c56-46d8-4b97-acde-50087ebf0cc3-kube-api-access-m7qgr\") pod \"authorino-8557fdb67f-jv7rk\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") " pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.513513 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.513455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:50:00.649510 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:00.649488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8557fdb67f-jv7rk"]
Jul 09 18:50:00.650517 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:50:00.650488    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01940c56_46d8_4b97_acde_50087ebf0cc3.slice/crio-1cac8d8d298a2c712d7a8e5b3c4a6826babfe91e9c2f1d49ce0f048124fd5058 WatchSource:0}: Error finding container 1cac8d8d298a2c712d7a8e5b3c4a6826babfe91e9c2f1d49ce0f048124fd5058: Status 404 returned error can't find the container with id 1cac8d8d298a2c712d7a8e5b3c4a6826babfe91e9c2f1d49ce0f048124fd5058
Jul 09 18:50:01.095932 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.095886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8557fdb67f-jv7rk" event={"ID":"01940c56-46d8-4b97-acde-50087ebf0cc3","Type":"ContainerStarted","Data":"29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4"}
Jul 09 18:50:01.096141 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.095940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8557fdb67f-jv7rk" event={"ID":"01940c56-46d8-4b97-acde-50087ebf0cc3","Type":"ContainerStarted","Data":"1cac8d8d298a2c712d7a8e5b3c4a6826babfe91e9c2f1d49ce0f048124fd5058"}
Jul 09 18:50:01.097714 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.097680    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9xg5s" podUID="4b241041-a0b0-4f65-9838-d4f11981512f" containerName="authorino" containerID="cri-o://4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e" gracePeriod=30
Jul 09 18:50:01.097836 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.097708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9xg5s" event={"ID":"4b241041-a0b0-4f65-9838-d4f11981512f","Type":"ContainerStarted","Data":"4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e"}
Jul 09 18:50:01.097836 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.097746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9xg5s" event={"ID":"4b241041-a0b0-4f65-9838-d4f11981512f","Type":"ContainerStarted","Data":"7a3433d24de4e580d108901029829835115a83f7706ef2f6af2f817efe8b7c03"}
Jul 09 18:50:01.097836 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.097690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:01.106223 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.106203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:01.117706 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.117671    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8557fdb67f-jv7rk" podStartSLOduration=0.812131213 podStartE2EDuration="1.11765767s" totalImagesPullingTime="305.526457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:50:01.115597505 +0000 UTC m=+513.924443941" watchObservedRunningTime="2026-07-09 18:50:01.11765767 +0000 UTC m=+513.926504082"
Jul 09 18:50:01.143098 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.142841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thhlx\" (UniqueName: \"kubernetes.io/projected/d5902a8a-d4b2-40eb-bf20-a0069e881a45-kube-api-access-thhlx\") pod \"d5902a8a-d4b2-40eb-bf20-a0069e881a45\" (UID: \"d5902a8a-d4b2-40eb-bf20-a0069e881a45\") "
Jul 09 18:50:01.145233 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.145211    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5902a8a-d4b2-40eb-bf20-a0069e881a45-kube-api-access-thhlx" (OuterVolumeSpecName: "kube-api-access-thhlx") pod "d5902a8a-d4b2-40eb-bf20-a0069e881a45" (UID: "d5902a8a-d4b2-40eb-bf20-a0069e881a45"). InnerVolumeSpecName "kube-api-access-thhlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:50:01.165487 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.165444    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9xg5s" podStartSLOduration=1.740028701 podStartE2EDuration="2.165430722s" totalImagesPullingTime="425.402021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:50:01.16528348 +0000 UTC m=+513.974129915" watchObservedRunningTime="2026-07-09 18:50:01.165430722 +0000 UTC m=+513.974277157"
Jul 09 18:50:01.244110 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.244083    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thhlx\" (UniqueName: \"kubernetes.io/projected/d5902a8a-d4b2-40eb-bf20-a0069e881a45-kube-api-access-thhlx\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:50:01.338855 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.338831    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:50:01.445497 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.445469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nlwk\" (UniqueName: \"kubernetes.io/projected/4b241041-a0b0-4f65-9838-d4f11981512f-kube-api-access-2nlwk\") pod \"4b241041-a0b0-4f65-9838-d4f11981512f\" (UID: \"4b241041-a0b0-4f65-9838-d4f11981512f\") "
Jul 09 18:50:01.447546 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.447518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b241041-a0b0-4f65-9838-d4f11981512f-kube-api-access-2nlwk" (OuterVolumeSpecName: "kube-api-access-2nlwk") pod "4b241041-a0b0-4f65-9838-d4f11981512f" (UID: "4b241041-a0b0-4f65-9838-d4f11981512f"). InnerVolumeSpecName "kube-api-access-2nlwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:50:01.546904 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:01.546856    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nlwk\" (UniqueName: \"kubernetes.io/projected/4b241041-a0b0-4f65-9838-d4f11981512f-kube-api-access-2nlwk\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:50:02.105256 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.105207    2578 generic.go:356] "Generic (PLEG): container finished" podID="4b241041-a0b0-4f65-9838-d4f11981512f" containerID="4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e" exitCode=0
Jul 09 18:50:02.105716 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.105245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9xg5s" event={"ID":"4b241041-a0b0-4f65-9838-d4f11981512f","Type":"ContainerDied","Data":"4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e"}
Jul 09 18:50:02.105716 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.105272    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9xg5s"
Jul 09 18:50:02.105716 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.105272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fb6996b99-lq9tg"
Jul 09 18:50:02.105716 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.105310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9xg5s" event={"ID":"4b241041-a0b0-4f65-9838-d4f11981512f","Type":"ContainerDied","Data":"7a3433d24de4e580d108901029829835115a83f7706ef2f6af2f817efe8b7c03"}
Jul 09 18:50:02.105716 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.105328    2578 scope.go:117] "RemoveContainer" containerID="4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e"
Jul 09 18:50:02.113965 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.113947    2578 scope.go:117] "RemoveContainer" containerID="4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e"
Jul 09 18:50:02.114226 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:50:02.114209    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e\": container with ID starting with 4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e not found: ID does not exist" containerID="4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e"
Jul 09 18:50:02.114287 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.114232    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e"} err="failed to get container status \"4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e\": rpc error: code = NotFound desc = could not find container \"4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e\": container with ID starting with 4c6afbd08b09858c6bfd081adf009ce1c3dc9acf4e88aea4876359a7c5a0126e not found: ID does not exist"
Jul 09 18:50:02.126921 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.126897    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9xg5s"]
Jul 09 18:50:02.131879 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.131857    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9xg5s"]
Jul 09 18:50:02.159042 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.159021    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fb6996b99-lq9tg"]
Jul 09 18:50:02.161059 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:02.161034    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fb6996b99-lq9tg"]
Jul 09 18:50:03.640231 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:03.640200    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b241041-a0b0-4f65-9838-d4f11981512f" path="/var/lib/kubelet/pods/4b241041-a0b0-4f65-9838-d4f11981512f/volumes"
Jul 09 18:50:03.640663 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:03.640567    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5902a8a-d4b2-40eb-bf20-a0069e881a45" path="/var/lib/kubelet/pods/d5902a8a-d4b2-40eb-bf20-a0069e881a45/volumes"
Jul 09 18:50:05.684439 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:05.684373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:05.812608 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:05.812577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:05.939994 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:05.939904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:06.031056 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:06.031010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:08.912543 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:08.912505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:09.020019 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:09.019985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:40.331162 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:40.331126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:40.821736 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:40.821706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:41.320086 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:41.320052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:41.418288 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:41.418254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:41.494952 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:41.494926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:50:41.562506 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:41.562478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:49.351982 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:49.351906    2578 generic.go:356] "Generic (PLEG): container finished" podID="5768b918-c6ad-4dbf-9c94-26a87992d1ca" containerID="fc9a3220df8fd499845e09983c33bc9d527de63e2399c0d16a94fc235d318564" exitCode=0
Jul 09 18:50:49.351982 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:49.351963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" event={"ID":"5768b918-c6ad-4dbf-9c94-26a87992d1ca","Type":"ContainerDied","Data":"fc9a3220df8fd499845e09983c33bc9d527de63e2399c0d16a94fc235d318564"}
Jul 09 18:50:49.352470 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:49.352446    2578 scope.go:117] "RemoveContainer" containerID="fc9a3220df8fd499845e09983c33bc9d527de63e2399c0d16a94fc235d318564"
Jul 09 18:50:49.353603 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:49.353572    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:50:49.353664 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:49.353651    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:50:49.353700 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:49.353692    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 18:50:50.358423 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:50.358366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" event={"ID":"5768b918-c6ad-4dbf-9c94-26a87992d1ca","Type":"ContainerStarted","Data":"aee5b998b07f9696576d59e0bae1d774cfc2e851f691b59654eb2c86b2c9d38b"}
Jul 09 18:50:50.959678 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:50.959642    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:50:50.959940 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:50.959912    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xbnnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:50:50.960046 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:50.959989    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" podUID="5768b918-c6ad-4dbf-9c94-26a87992d1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 18:50:51.959142 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:51.959111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:51.959617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:51.959339    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xbnnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:50:51.959617 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:51.959430    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" podUID="5768b918-c6ad-4dbf-9c94-26a87992d1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 18:50:52.059052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:52.059023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:50:52.960260 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:52.960224    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xbnnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:50:52.960734 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:52.960304    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" podUID="5768b918-c6ad-4dbf-9c94-26a87992d1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 18:50:53.959622 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:53.959583    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xbnnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 18:50:53.959789 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:53.959630    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl" podUID="5768b918-c6ad-4dbf-9c94-26a87992d1ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 18:50:54.963794 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:54.963760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:50:54.964302 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:54.964053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:50:54.964936 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:50:54.964916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xbnnl"
Jul 09 18:51:04.812625 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:04.812583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:05.250697 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:05.250666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:51:10.254727 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:10.254687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:11.069262 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:11.069227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:51:13.048372 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:13.048337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:22.660694 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:22.660646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:22.764727 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:22.764692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:27.552264 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:27.552236    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:51:27.552738 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:27.552666    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:51:27.559639 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:27.559613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:51:27.560156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:27.560127    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:51:32.600294 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:32.600258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:33.750675 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:33.750639    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:51:34.404720 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:34.404680    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:42.107581 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:42.107544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:43.204772 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:43.204735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:57.799302 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:57.799219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:51:59.252163 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:51:59.252135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:52:04.659680 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.659646    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"]
Jul 09 18:52:04.660051 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.660015    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b241041-a0b0-4f65-9838-d4f11981512f" containerName="authorino"
Jul 09 18:52:04.660051 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.660026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b241041-a0b0-4f65-9838-d4f11981512f" containerName="authorino"
Jul 09 18:52:04.660136 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.660109    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b241041-a0b0-4f65-9838-d4f11981512f" containerName="authorino"
Jul 09 18:52:04.663209 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.663190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.668459 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.668435    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gqjpx\""
Jul 09 18:52:04.668459 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.668453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 18:52:04.668764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.668456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 18:52:04.668764 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.668453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 18:52:04.675606 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.675584    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"]
Jul 09 18:52:04.713843 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.713819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:52:04.771842 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.771818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.771931 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.771845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.771931 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.771921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8mt\" (UniqueName: \"kubernetes.io/projected/e294a4a9-1226-404e-b211-068c3ab3bb0b-kube-api-access-bl8mt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.772004 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.771952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.772045 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.772012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e294a4a9-1226-404e-b211-068c3ab3bb0b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.772079 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.772057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.872869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.872842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.872869 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.872871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.872912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8mt\" (UniqueName: \"kubernetes.io/projected/e294a4a9-1226-404e-b211-068c3ab3bb0b-kube-api-access-bl8mt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.872936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.872973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e294a4a9-1226-404e-b211-068c3ab3bb0b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873016 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.873006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873315 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.873280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873371 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.873357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.873448 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.873429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.875412 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.875354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e294a4a9-1226-404e-b211-068c3ab3bb0b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.875685 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.875666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e294a4a9-1226-404e-b211-068c3ab3bb0b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.886172 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.886150    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8mt\" (UniqueName: \"kubernetes.io/projected/e294a4a9-1226-404e-b211-068c3ab3bb0b-kube-api-access-bl8mt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xl9d5\" (UID: \"e294a4a9-1226-404e-b211-068c3ab3bb0b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:04.973543 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:04.973523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:05.111473 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:05.111446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"]
Jul 09 18:52:05.113750 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:52:05.113724    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode294a4a9_1226_404e_b211_068c3ab3bb0b.slice/crio-290e1f408496ad362c6a5e2046d23a39f19c4037351659858292251718ac8785 WatchSource:0}: Error finding container 290e1f408496ad362c6a5e2046d23a39f19c4037351659858292251718ac8785: Status 404 returned error can't find the container with id 290e1f408496ad362c6a5e2046d23a39f19c4037351659858292251718ac8785
Jul 09 18:52:05.115095 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:05.115080    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:52:05.774006 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:05.773972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5" event={"ID":"e294a4a9-1226-404e-b211-068c3ab3bb0b","Type":"ContainerStarted","Data":"290e1f408496ad362c6a5e2046d23a39f19c4037351659858292251718ac8785"}
Jul 09 18:52:06.780924 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:06.780884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5" event={"ID":"e294a4a9-1226-404e-b211-068c3ab3bb0b","Type":"ContainerStarted","Data":"5dfc35be745be4c8010441a7dc95489d9b9ca3f8026958831be3c2e5b1578e85"}
Jul 09 18:52:06.805775 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:06.805729    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5" podStartSLOduration=1.731412342 podStartE2EDuration="2.805713384s" totalImagesPullingTime="1.074301042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:52:06.803040292 +0000 UTC m=+639.611886727" watchObservedRunningTime="2026-07-09 18:52:06.805713384 +0000 UTC m=+639.614559820"
Jul 09 18:52:06.857183 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:06.857150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:52:14.974023 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:14.973986    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:14.974513 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:14.974050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:14.986451 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:14.986428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:15.131962 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.131936    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"]
Jul 09 18:52:15.135637 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.135621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.139116 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.139096    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 18:52:15.146237 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.146211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"]
Jul 09 18:52:15.169661 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.169634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:52:15.266989 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.266919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3905cc4-9186-4ba6-bd3c-ad5e00906348-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.266989 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.266971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.267140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.267036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.267140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.267079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.267140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.267110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnhs\" (UniqueName: \"kubernetes.io/projected/f3905cc4-9186-4ba6-bd3c-ad5e00906348-kube-api-access-slnhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.267140 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.267135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.367932 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.367904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnhs\" (UniqueName: \"kubernetes.io/projected/f3905cc4-9186-4ba6-bd3c-ad5e00906348-kube-api-access-slnhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.367935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.367973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3905cc4-9186-4ba6-bd3c-ad5e00906348-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.368006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368052 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.368025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368225 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.368059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368438 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.368417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368517 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.368450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.368517 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.368481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.370224 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.370209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3905cc4-9186-4ba6-bd3c-ad5e00906348-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.370628 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.370607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3905cc4-9186-4ba6-bd3c-ad5e00906348-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.378576 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.378554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnhs\" (UniqueName: \"kubernetes.io/projected/f3905cc4-9186-4ba6-bd3c-ad5e00906348-kube-api-access-slnhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9\" (UID: \"f3905cc4-9186-4ba6-bd3c-ad5e00906348\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.445457 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.445434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:15.583862 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.583837    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"]
Jul 09 18:52:15.585969 ip-10-0-129-245 kubenswrapper[2578]: W0709 18:52:15.585942    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3905cc4_9186_4ba6_bd3c_ad5e00906348.slice/crio-c2261b0359cbb5bbc4ef6ad657afc1b90a3684730d461a27edcb2007048273cf WatchSource:0}: Error finding container c2261b0359cbb5bbc4ef6ad657afc1b90a3684730d461a27edcb2007048273cf: Status 404 returned error can't find the container with id c2261b0359cbb5bbc4ef6ad657afc1b90a3684730d461a27edcb2007048273cf
Jul 09 18:52:15.833171 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.833145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9" event={"ID":"f3905cc4-9186-4ba6-bd3c-ad5e00906348","Type":"ContainerStarted","Data":"2c722ef1b74d1c6175f392952c865deff849aed27ae4008e95f0c06606e0c4c8"}
Jul 09 18:52:15.833301 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.833186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9" event={"ID":"f3905cc4-9186-4ba6-bd3c-ad5e00906348","Type":"ContainerStarted","Data":"c2261b0359cbb5bbc4ef6ad657afc1b90a3684730d461a27edcb2007048273cf"}
Jul 09 18:52:15.845105 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.845072    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xl9d5"
Jul 09 18:52:15.855740 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:15.855697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9" podStartSLOduration=0.675418889 podStartE2EDuration="855.683539ms" totalImagesPullingTime="180.26465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:52:15.853951525 +0000 UTC m=+648.662797962" watchObservedRunningTime="2026-07-09 18:52:15.855683539 +0000 UTC m=+648.664529971"
Jul 09 18:52:17.766080 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:17.766048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:52:25.449402 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:25.446065    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:25.449402 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:25.446152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:25.464275 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:25.464246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:25.895810 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:25.895739    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9"
Jul 09 18:52:27.382171 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:27.382130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:52:41.547105 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:41.547056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:52:41.642634 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:52:41.642600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:53:25.795022 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:25.794938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:53:25.901105 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:25.901078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:53:27.007204 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.007155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:53:27.145230 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.145177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:53:27.274274 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.274182    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8557fdb67f-jv7rk"]
Jul 09 18:53:27.274455 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.274401    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8557fdb67f-jv7rk" podUID="01940c56-46d8-4b97-acde-50087ebf0cc3" containerName="authorino" containerID="cri-o://29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4" gracePeriod=30
Jul 09 18:53:27.528328 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.528269    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:53:27.583248 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.583222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7qgr\" (UniqueName: \"kubernetes.io/projected/01940c56-46d8-4b97-acde-50087ebf0cc3-kube-api-access-m7qgr\") pod \"01940c56-46d8-4b97-acde-50087ebf0cc3\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") "
Jul 09 18:53:27.583580 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.583286    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01940c56-46d8-4b97-acde-50087ebf0cc3-tls-cert\") pod \"01940c56-46d8-4b97-acde-50087ebf0cc3\" (UID: \"01940c56-46d8-4b97-acde-50087ebf0cc3\") "
Jul 09 18:53:27.586046 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.586008    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01940c56-46d8-4b97-acde-50087ebf0cc3-kube-api-access-m7qgr" (OuterVolumeSpecName: "kube-api-access-m7qgr") pod "01940c56-46d8-4b97-acde-50087ebf0cc3" (UID: "01940c56-46d8-4b97-acde-50087ebf0cc3"). InnerVolumeSpecName "kube-api-access-m7qgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:27.595298 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.595270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01940c56-46d8-4b97-acde-50087ebf0cc3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "01940c56-46d8-4b97-acde-50087ebf0cc3" (UID: "01940c56-46d8-4b97-acde-50087ebf0cc3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:53:27.683964 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.683922    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7qgr\" (UniqueName: \"kubernetes.io/projected/01940c56-46d8-4b97-acde-50087ebf0cc3-kube-api-access-m7qgr\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:53:27.683964 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:27.683949    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01940c56-46d8-4b97-acde-50087ebf0cc3-tls-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 18:53:28.206204 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.206175    2578 generic.go:356] "Generic (PLEG): container finished" podID="01940c56-46d8-4b97-acde-50087ebf0cc3" containerID="29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4" exitCode=0
Jul 09 18:53:28.206665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.206233    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8557fdb67f-jv7rk"
Jul 09 18:53:28.206665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.206262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8557fdb67f-jv7rk" event={"ID":"01940c56-46d8-4b97-acde-50087ebf0cc3","Type":"ContainerDied","Data":"29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4"}
Jul 09 18:53:28.206665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.206306    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8557fdb67f-jv7rk" event={"ID":"01940c56-46d8-4b97-acde-50087ebf0cc3","Type":"ContainerDied","Data":"1cac8d8d298a2c712d7a8e5b3c4a6826babfe91e9c2f1d49ce0f048124fd5058"}
Jul 09 18:53:28.206665 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.206325    2578 scope.go:117] "RemoveContainer" containerID="29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4"
Jul 09 18:53:28.216953 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.216210    2578 scope.go:117] "RemoveContainer" containerID="29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4"
Jul 09 18:53:28.217450 ip-10-0-129-245 kubenswrapper[2578]: E0709 18:53:28.217428    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4\": container with ID starting with 29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4 not found: ID does not exist" containerID="29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4"
Jul 09 18:53:28.217526 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.217459    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4"} err="failed to get container status \"29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4\": rpc error: code = NotFound desc = could not find container \"29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4\": container with ID starting with 29f32d7847a7ea71ed667b76a4dafba7f8e80a9b663578d81d88c28ad4e3eab4 not found: ID does not exist"
Jul 09 18:53:28.232258 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.232235    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8557fdb67f-jv7rk"]
Jul 09 18:53:28.243569 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:28.243542    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8557fdb67f-jv7rk"]
Jul 09 18:53:29.639815 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:29.639777    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01940c56-46d8-4b97-acde-50087ebf0cc3" path="/var/lib/kubelet/pods/01940c56-46d8-4b97-acde-50087ebf0cc3/volumes"
Jul 09 18:53:55.764435 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:53:55.764371    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:54:05.177087 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:54:05.177040    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:54:17.381885 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:54:17.381839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:54:25.052601 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:54:25.052565    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:54:35.851887 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:54:35.851850    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:54:38.222156 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:54:38.222088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:54:40.207991 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:54:40.207952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:13.928200 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:13.928157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:14.031324 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:14.031293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:14.163542 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:14.163506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:20.904648 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:20.904608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:21.011091 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:21.011041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:21.106534 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:21.106500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:21.273499 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:21.273474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:27.550709 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:27.550666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:27.622822 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:27.622774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:55:45.154369 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:45.154330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:55:54.652707 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:55:54.652671    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:56:04.556119 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:04.556056    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:56:10.751961 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:10.751931    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:56:21.974261 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:21.974183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:56:27.588892 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:27.588856    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:56:27.589847 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:27.589818    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 18:56:27.596364 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:27.596344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:56:27.597459 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:27.597439    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 18:56:33.066184 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:33.066151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:56:43.667979 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:43.667942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:56:52.656783 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:56:52.656742    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:57:14.444191 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:57:14.444160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:57:25.556729 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:57:25.556696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:57:49.258084 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:57:49.258001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:57:59.751904 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:57:59.751860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:58:14.958041 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:14.958002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:58:16.485046 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:16.485011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:58:25.212955 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:25.212916    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:58:34.275402 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:34.275345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:58:35.881642 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:35.881593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:58:43.963412 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:43.963363    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 18:58:45.664037 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:45.663982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 18:58:52.655048 ip-10-0-129-245 kubenswrapper[2578]: I0709 18:58:52.655009    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:00:05.281254 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:00:05.281210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:05.383675 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:00:05.383641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:43.458161 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:00:43.458127    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:00:51.951795 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:00:51.951760    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:01:06.862421 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:06.862372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:01:15.358225 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:15.358183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:01:26.056832 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:26.056800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:01:27.623771 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:27.623740    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:01:27.625581 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:27.625556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:01:27.630116 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:27.630101    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:01:27.632017 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:27.631999    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:01:34.268885 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:34.268851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:01:44.361504 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:44.361465    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:01:54.944438 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:01:54.944399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:02:03.965227 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:02:03.965192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:02:15.359431 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:02:15.359395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:02:26.353239 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:02:26.353147    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:02:33.958955 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:02:33.958920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:02:51.563176 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:02:51.563141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:03:00.861363 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:03:00.861328    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:03:11.064973 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:03:11.064940    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:03:21.449869 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:03:21.449839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:03:29.558958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:03:29.558919    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:03:38.961846 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:03:38.961816    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:03:52.745047 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:03:52.744943    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:04:03.157688 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:03.157649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:04:11.357800 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:11.357771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:04:21.057296 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:21.057264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:04:30.455171 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:30.455129    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:04:43.751430 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:43.751392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:04:46.051241 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:46.051206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.887212 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:04:52.887176    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:05:02.492201 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:05:02.492167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:05:14.958374 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:05:14.958340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:05:26.689881 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:05:26.689796    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:05:34.947312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:05:34.947268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:05:46.664390 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:05:46.664340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:05:58.848831 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:05:58.848795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:03.501354 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:03.501322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:08.159973 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:08.159941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:10.720702 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:10.720668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:18.260344 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:18.260312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:21.966970 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:21.966935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:26.728930 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:26.728893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:27.656572 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:27.656546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:06:27.660709 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:27.660686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:06:27.663013 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:27.662997    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:06:27.666973 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:27.666953    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:06:29.183245 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:29.183216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:30.738515 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:30.738484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:32.498577 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:32.498540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:34.650349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:34.650317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:34.745568 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:34.745542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:35.093564 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:35.093535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:40.049624 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:40.049591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:41.181906 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.181880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:41.281445 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.281420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:41.390222 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.390188    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"]
Jul 09 19:06:41.390605 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.390588    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01940c56-46d8-4b97-acde-50087ebf0cc3" containerName="authorino"
Jul 09 19:06:41.390605 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.390604    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="01940c56-46d8-4b97-acde-50087ebf0cc3" containerName="authorino"
Jul 09 19:06:41.390755 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.390684    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="01940c56-46d8-4b97-acde-50087ebf0cc3" containerName="authorino"
Jul 09 19:06:41.393770 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.393749    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.398010 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.397988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-231d4590-openshift-default-dockercfg-rf29g\""
Jul 09 19:06:41.423815 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.423792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"]
Jul 09 19:06:41.433885 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.433831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:41.507554 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-data\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-credential-socket\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istiod-ca-cert\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507775 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-token\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507775 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-socket\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507775 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-podinfo\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507892 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-certs\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507892 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-envoy\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.507892 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.507867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsz54\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-kube-api-access-qsz54\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.530578 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.530537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:41.608817 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istiod-ca-cert\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.608929 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-token\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.608929 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-socket\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.608929 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-podinfo\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.608929 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-certs\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.609151 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-envoy\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.609151 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.608992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsz54\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-kube-api-access-qsz54\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.609151 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.609024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-data\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.609151 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.609054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-credential-socket\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.609361 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.609310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-certs\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.609457 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.609411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-socket\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.610021 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.609957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-data\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.610196 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.610119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istiod-ca-cert\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.610314 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.610266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-credential-socket\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.617669 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.617639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-envoy\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.618583 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.618554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-podinfo\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.620064 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.620032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-token\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.620636 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.620618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsz54\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-kube-api-access-qsz54\") pod \"e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") " pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.703803 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.703751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:41.849063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.849034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"]
Jul 09 19:06:41.849804 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:06:41.849768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dbb138_b2ac_49cb_a18e_46d91b0a4266.slice/crio-ef899eb8fa38439ece2c8d0650eac137f010880c02bbb412475156d0f5d860a6 WatchSource:0}: Error finding container ef899eb8fa38439ece2c8d0650eac137f010880c02bbb412475156d0f5d860a6: Status 404 returned error can't find the container with id ef899eb8fa38439ece2c8d0650eac137f010880c02bbb412475156d0f5d860a6
Jul 09 19:06:41.852180 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.852148    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:06:41.852241 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.852210    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:06:41.852278 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:41.852239    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:06:42.290865 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.290829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85" event={"ID":"32dbb138-b2ac-49cb-a18e-46d91b0a4266","Type":"ContainerStarted","Data":"3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750"}
Jul 09 19:06:42.291245 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.290888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85" event={"ID":"32dbb138-b2ac-49cb-a18e-46d91b0a4266","Type":"ContainerStarted","Data":"ef899eb8fa38439ece2c8d0650eac137f010880c02bbb412475156d0f5d860a6"}
Jul 09 19:06:42.315185 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.315141    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85" podStartSLOduration=1.315128684 podStartE2EDuration="1.315128684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:42.313145087 +0000 UTC m=+1515.121991522" watchObservedRunningTime="2026-07-09 19:06:42.315128684 +0000 UTC m=+1515.123975118"
Jul 09 19:06:42.609398 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.609299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:42.704029 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.704000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:42.708541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.708523    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:42.735083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.735053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:42.886541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.886446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:42.986306 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:42.986274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:43.295388 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:43.295359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:43.296264 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:43.296243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:43.332817 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:43.332780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:43.401345 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:43.401322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:45.480601 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:45.480570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:50.749786 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:50.749708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:50.823940 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:50.823904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:50.910490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:50.910450    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"]
Jul 09 19:06:50.910701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:50.910676    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85" podUID="32dbb138-b2ac-49cb-a18e-46d91b0a4266" containerName="istio-proxy" containerID="cri-o://3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750" gracePeriod=30
Jul 09 19:06:50.941287 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:50.941263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:51.030235 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:51.030160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:51.147683 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:51.147649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:52.519465 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:52.519435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:54.570365 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.570341    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:54.741936 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.741916    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-envoy\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.741958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-credential-socket\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.741989    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-token\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istiod-ca-cert\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsz54\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-kube-api-access-qsz54\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742066    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-socket\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-data\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742158    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-certs\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742192    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-podinfo\") pod \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\" (UID: \"32dbb138-b2ac-49cb-a18e-46d91b0a4266\") "
Jul 09 19:06:54.742267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742243    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:06:54.742625 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:06:54.742625 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742507    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.742625 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742510    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:06:54.742893 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.742668    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:06:54.743324 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.743292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-data" (OuterVolumeSpecName: "istio-data") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:06:54.744309 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.744283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:06:54.744500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.744318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-kube-api-access-qsz54" (OuterVolumeSpecName: "kube-api-access-qsz54") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "kube-api-access-qsz54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:54.744500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.744429    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-token" (OuterVolumeSpecName: "istio-token") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:54.744500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.744484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32dbb138-b2ac-49cb-a18e-46d91b0a4266" (UID: "32dbb138-b2ac-49cb-a18e-46d91b0a4266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:06:54.842957 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.842933    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsz54\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-kube-api-access-qsz54\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.842957 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.842955    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.843080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.842965    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.843080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.842973    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.843080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.842980    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.843080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.843005    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.843080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.843013    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:54.843080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:54.843020    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32dbb138-b2ac-49cb-a18e-46d91b0a4266-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:06:55.353985 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.353951    2578 generic.go:356] "Generic (PLEG): container finished" podID="32dbb138-b2ac-49cb-a18e-46d91b0a4266" containerID="3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750" exitCode=0
Jul 09 19:06:55.354167 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.353989    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85" event={"ID":"32dbb138-b2ac-49cb-a18e-46d91b0a4266","Type":"ContainerDied","Data":"3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750"}
Jul 09 19:06:55.354167 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.353999    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"
Jul 09 19:06:55.354167 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.354034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85" event={"ID":"32dbb138-b2ac-49cb-a18e-46d91b0a4266","Type":"ContainerDied","Data":"ef899eb8fa38439ece2c8d0650eac137f010880c02bbb412475156d0f5d860a6"}
Jul 09 19:06:55.354167 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.354059    2578 scope.go:117] "RemoveContainer" containerID="3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750"
Jul 09 19:06:55.363762 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.363748    2578 scope.go:117] "RemoveContainer" containerID="3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750"
Jul 09 19:06:55.364006 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:06:55.363986    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750\": container with ID starting with 3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750 not found: ID does not exist" containerID="3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750"
Jul 09 19:06:55.364063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.364014    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750"} err="failed to get container status \"3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750\": rpc error: code = NotFound desc = could not find container \"3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750\": container with ID starting with 3bcd3bcb42305c14eb13bfd04a23f6f5cc81844dc309ea3dfe003d0d0d348750 not found: ID does not exist"
Jul 09 19:06:55.382364 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.382342    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"]
Jul 09 19:06:55.388247 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.388223    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-231d4590-openshift-default-7bfdc8bbbc-xht85"]
Jul 09 19:06:55.639574 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:55.639515    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32dbb138-b2ac-49cb-a18e-46d91b0a4266" path="/var/lib/kubelet/pods/32dbb138-b2ac-49cb-a18e-46d91b0a4266/volumes"
Jul 09 19:06:57.475814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.475762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:57.547071 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.547043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:57.667410 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.667364    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"]
Jul 09 19:06:57.667966 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.667944    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dbb138-b2ac-49cb-a18e-46d91b0a4266" containerName="istio-proxy"
Jul 09 19:06:57.668079 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.667969    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dbb138-b2ac-49cb-a18e-46d91b0a4266" containerName="istio-proxy"
Jul 09 19:06:57.668164 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.668138    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="32dbb138-b2ac-49cb-a18e-46d91b0a4266" containerName="istio-proxy"
Jul 09 19:06:57.671642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.671623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.676846 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.676824    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b10d3200-openshift-default-dockercfg-zvq9d\""
Jul 09 19:06:57.692948 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.692923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"]
Jul 09 19:06:57.741482 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.741428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:57.768016 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.767993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-credential-socket\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768138 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-socket\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768138 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-certs\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-data\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-envoy\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-podinfo\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-token\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mb5f\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-kube-api-access-9mb5f\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.768418 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.768351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istiod-ca-cert\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.828791 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.828754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:57.869443 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-certs\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869564 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-data\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869564 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-envoy\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869655 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-podinfo\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869655 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-token\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869761 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mb5f\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-kube-api-access-9mb5f\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869761 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istiod-ca-cert\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869860 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-credential-socket\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869860 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-socket\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.869860 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-data\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.870012 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.869876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-certs\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.870187 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.870088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-credential-socket\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.870447 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.870422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-socket\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.870552 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.870449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istiod-ca-cert\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.871741 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.871722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-envoy\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.872032 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.872017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-podinfo\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.880532 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.880504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-token\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.880696 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.880679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mb5f\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-kube-api-access-9mb5f\") pod \"e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") " pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:57.952124 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.952101    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:06:57.984255 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:57.984234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:58.127523 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.127499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"]
Jul 09 19:06:58.129366 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:06:58.129338    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64fbda4_28a3_4bcd_b440_28f8de78deb4.slice/crio-12dbb148815594474e31807846ab76f1e70f2d5c2e1d019b9be964aa061e473d WatchSource:0}: Error finding container 12dbb148815594474e31807846ab76f1e70f2d5c2e1d019b9be964aa061e473d: Status 404 returned error can't find the container with id 12dbb148815594474e31807846ab76f1e70f2d5c2e1d019b9be964aa061e473d
Jul 09 19:06:58.131563 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.131533    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:06:58.131638 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.131616    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:06:58.131678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.131644    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:06:58.377877 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.377786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt" event={"ID":"b64fbda4-28a3-4bcd-b440-28f8de78deb4","Type":"ContainerStarted","Data":"0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb"}
Jul 09 19:06:58.377877 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.377848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt" event={"ID":"b64fbda4-28a3-4bcd-b440-28f8de78deb4","Type":"ContainerStarted","Data":"12dbb148815594474e31807846ab76f1e70f2d5c2e1d019b9be964aa061e473d"}
Jul 09 19:06:58.404438 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.404362    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt" podStartSLOduration=1.404344565 podStartE2EDuration="1.404344565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:58.40215642 +0000 UTC m=+1531.211002854" watchObservedRunningTime="2026-07-09 19:06:58.404344565 +0000 UTC m=+1531.213191449"
Jul 09 19:06:58.895971 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.895940    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:58.984480 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.984452    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:58.993668 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:58.993640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:59.146329 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:59.146253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:59.455051 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:59.455020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:59.989440 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:59.989414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:06:59.994480 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:06:59.994460    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:00.097473 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:00.097443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:00.387518 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:00.387454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:07:00.388419 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:00.388374    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:07:00.980019 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:00.979992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:06.965364 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:06.965327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:07.066623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:07.066573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:07.946299 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:07.946268    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"]
Jul 09 19:07:07.946556 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:07.946526    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt" podUID="b64fbda4-28a3-4bcd-b440-28f8de78deb4" containerName="istio-proxy" containerID="cri-o://0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb" gracePeriod=30
Jul 09 19:07:07.974848 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:07.974816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:08.066673 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:08.066600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:10.802500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.802479    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:07:10.888293 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-token\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888440 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-credential-socket\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888440 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888320    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-certs\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888440 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-socket\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888440 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mb5f\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-kube-api-access-9mb5f\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888440 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istiod-ca-cert\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888466    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-podinfo\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-envoy\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888566    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-data\") pod \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\" (UID: \"b64fbda4-28a3-4bcd-b440-28f8de78deb4\") "
Jul 09 19:07:10.888701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888634    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:10.888701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:10.888959 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:10.888959 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888953    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.889075 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888970    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.889075 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888985    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.889075 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.888982    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:07:10.889593 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.889454    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:10.890992 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.890964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:10.891083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.891030    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:10.891294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.891272    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-kube-api-access-9mb5f" (OuterVolumeSpecName: "kube-api-access-9mb5f") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "kube-api-access-9mb5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:10.891294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.891277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b64fbda4-28a3-4bcd-b440-28f8de78deb4" (UID: "b64fbda4-28a3-4bcd-b440-28f8de78deb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:07:10.990010 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.989981    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.990010 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.990007    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mb5f\" (UniqueName: \"kubernetes.io/projected/b64fbda4-28a3-4bcd-b440-28f8de78deb4-kube-api-access-9mb5f\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.990218 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.990021    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.990218 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.990033    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.990218 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.990044    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:10.990218 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:10.990055    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b64fbda4-28a3-4bcd-b440-28f8de78deb4-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:11.447455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.447425    2578 generic.go:356] "Generic (PLEG): container finished" podID="b64fbda4-28a3-4bcd-b440-28f8de78deb4" containerID="0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb" exitCode=0
Jul 09 19:07:11.447582 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.447472    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"
Jul 09 19:07:11.447582 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.447521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt" event={"ID":"b64fbda4-28a3-4bcd-b440-28f8de78deb4","Type":"ContainerDied","Data":"0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb"}
Jul 09 19:07:11.447704 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.447586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt" event={"ID":"b64fbda4-28a3-4bcd-b440-28f8de78deb4","Type":"ContainerDied","Data":"12dbb148815594474e31807846ab76f1e70f2d5c2e1d019b9be964aa061e473d"}
Jul 09 19:07:11.447704 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.447618    2578 scope.go:117] "RemoveContainer" containerID="0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb"
Jul 09 19:07:11.456647 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.456634    2578 scope.go:117] "RemoveContainer" containerID="0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb"
Jul 09 19:07:11.456904 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:07:11.456887    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb\": container with ID starting with 0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb not found: ID does not exist" containerID="0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb"
Jul 09 19:07:11.456949 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.456911    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb"} err="failed to get container status \"0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb\": rpc error: code = NotFound desc = could not find container \"0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb\": container with ID starting with 0dc539847e8e410e83f758358c47762012b4dcb0625e85734c3cd6dce6f21fbb not found: ID does not exist"
Jul 09 19:07:11.475794 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.475776    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"]
Jul 09 19:07:11.484132 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.484112    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b10d3200-openshift-default-7d5555484c-2xxqt"]
Jul 09 19:07:11.542902 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.542876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:11.640981 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:11.640943    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64fbda4-28a3-4bcd-b440-28f8de78deb4" path="/var/lib/kubelet/pods/b64fbda4-28a3-4bcd-b440-28f8de78deb4/volumes"
Jul 09 19:07:14.482203 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.482170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:14.584639 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.584614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:14.695227 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.695187    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"]
Jul 09 19:07:14.695681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.695666    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64fbda4-28a3-4bcd-b440-28f8de78deb4" containerName="istio-proxy"
Jul 09 19:07:14.695788 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.695683    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64fbda4-28a3-4bcd-b440-28f8de78deb4" containerName="istio-proxy"
Jul 09 19:07:14.695788 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.695763    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64fbda4-28a3-4bcd-b440-28f8de78deb4" containerName="istio-proxy"
Jul 09 19:07:14.700244 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.700224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.705155 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.705136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a9f3f7be-openshift-default-dockercfg-c9fj4\""
Jul 09 19:07:14.713555 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.713531    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"]
Jul 09 19:07:14.727724 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.727696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:14.823695 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-envoy\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823695 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsw6j\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-kube-api-access-lsw6j\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823695 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-credential-socket\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-certs\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-socket\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-data\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-token\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.823887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baa4bea-ff1d-4c84-86d5-42afea7193df-istiod-ca-cert\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.824043 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.823898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-podinfo\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.828518 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.828491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:14.925035 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-data\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925035 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-token\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baa4bea-ff1d-4c84-86d5-42afea7193df-istiod-ca-cert\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-podinfo\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-envoy\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsw6j\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-kube-api-access-lsw6j\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-credential-socket\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-certs\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925529 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-socket\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925529 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-data\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925712 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-credential-socket\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925780 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-socket\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925851 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-certs\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.925980 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.925959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baa4bea-ff1d-4c84-86d5-42afea7193df-istiod-ca-cert\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.927516 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.927497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-envoy\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.927802 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.927784    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-podinfo\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.935490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.935467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-token\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:14.936503 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:14.936479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsw6j\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-kube-api-access-lsw6j\") pod \"e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") " pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:15.011644 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.011617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:15.153455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.153418    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"]
Jul 09 19:07:15.155815 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:07:15.155790    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baa4bea_ff1d_4c84_86d5_42afea7193df.slice/crio-3b4836ea9c72162c9c8552acb9f1cfe4bcffd0c2982ceec1c812e07ac75993ad WatchSource:0}: Error finding container 3b4836ea9c72162c9c8552acb9f1cfe4bcffd0c2982ceec1c812e07ac75993ad: Status 404 returned error can't find the container with id 3b4836ea9c72162c9c8552acb9f1cfe4bcffd0c2982ceec1c812e07ac75993ad
Jul 09 19:07:15.158007 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.157978    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:07:15.158077 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.158046    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:07:15.158114 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.158080    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:07:15.471221 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.471181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h" event={"ID":"2baa4bea-ff1d-4c84-86d5-42afea7193df","Type":"ContainerStarted","Data":"979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5"}
Jul 09 19:07:15.471409 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.471244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h" event={"ID":"2baa4bea-ff1d-4c84-86d5-42afea7193df","Type":"ContainerStarted","Data":"3b4836ea9c72162c9c8552acb9f1cfe4bcffd0c2982ceec1c812e07ac75993ad"}
Jul 09 19:07:15.518931 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.518886    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h" podStartSLOduration=1.518871539 podStartE2EDuration="1.518871539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:15.518687081 +0000 UTC m=+1548.327533518" watchObservedRunningTime="2026-07-09 19:07:15.518871539 +0000 UTC m=+1548.327717974"
Jul 09 19:07:15.921207 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:15.921174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:16.012442 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.012409    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:16.017213 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.017188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:16.019726 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.019701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:16.227873 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.227775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:16.477137 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.477104    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:16.478161 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.478109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:16.559233 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.559195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:16.933613 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:16.933586    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:17.082601 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:17.082564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:18.071405 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:18.071353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:19.152448 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:19.152404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:07:23.255230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:23.255202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:23.357103 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:23.357065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:23.406405 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:23.405097    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"]
Jul 09 19:07:23.406405 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:23.405360    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h" podUID="2baa4bea-ff1d-4c84-86d5-42afea7193df" containerName="istio-proxy" containerID="cri-o://979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5" gracePeriod=30
Jul 09 19:07:23.435187 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:23.435160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:23.531339 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:23.531257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:26.968000 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:26.967975    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:27.046851 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.046823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsw6j\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-kube-api-access-lsw6j\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047013 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.046904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-socket\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047013 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.046928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-credential-socket\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047013 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.046959    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-token\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047013 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.046984    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-podinfo\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047242 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047039    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baa4bea-ff1d-4c84-86d5-42afea7193df-istiod-ca-cert\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047242 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047073    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-certs\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047242 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-envoy\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047242 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-data\") pod \"2baa4bea-ff1d-4c84-86d5-42afea7193df\" (UID: \"2baa4bea-ff1d-4c84-86d5-42afea7193df\") "
Jul 09 19:07:27.047502 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047329    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:27.047583 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047556    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:27.047583 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047576    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.047869 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2baa4bea-ff1d-4c84-86d5-42afea7193df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:07:27.047931 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.047914    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:27.048253 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.048233    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-data" (OuterVolumeSpecName: "istio-data") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:27.049724 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.049697    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-token" (OuterVolumeSpecName: "istio-token") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:27.049829 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.049697    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-kube-api-access-lsw6j" (OuterVolumeSpecName: "kube-api-access-lsw6j") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "kube-api-access-lsw6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:27.049885 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.049847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:07:27.049923 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.049906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2baa4bea-ff1d-4c84-86d5-42afea7193df" (UID: "2baa4bea-ff1d-4c84-86d5-42afea7193df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:27.149001 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.148969    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149001 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149002    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baa4bea-ff1d-4c84-86d5-42afea7193df-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149001 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149010    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149198 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149019    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149198 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149027    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149198 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149034    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsw6j\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-kube-api-access-lsw6j\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149198 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149045    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baa4bea-ff1d-4c84-86d5-42afea7193df-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.149198 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.149054    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baa4bea-ff1d-4c84-86d5-42afea7193df-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:07:27.542979 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.542945    2578 generic.go:356] "Generic (PLEG): container finished" podID="2baa4bea-ff1d-4c84-86d5-42afea7193df" containerID="979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5" exitCode=0
Jul 09 19:07:27.543158 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.542987    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"
Jul 09 19:07:27.543158 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.543019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h" event={"ID":"2baa4bea-ff1d-4c84-86d5-42afea7193df","Type":"ContainerDied","Data":"979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5"}
Jul 09 19:07:27.543158 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.543091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h" event={"ID":"2baa4bea-ff1d-4c84-86d5-42afea7193df","Type":"ContainerDied","Data":"3b4836ea9c72162c9c8552acb9f1cfe4bcffd0c2982ceec1c812e07ac75993ad"}
Jul 09 19:07:27.543158 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.543114    2578 scope.go:117] "RemoveContainer" containerID="979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5"
Jul 09 19:07:27.552811 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.552790    2578 scope.go:117] "RemoveContainer" containerID="979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5"
Jul 09 19:07:27.553060 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:07:27.553042    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5\": container with ID starting with 979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5 not found: ID does not exist" containerID="979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5"
Jul 09 19:07:27.553109 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.553074    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5"} err="failed to get container status \"979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5\": rpc error: code = NotFound desc = could not find container \"979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5\": container with ID starting with 979cf5c552d61a2b404587caf7ec11c162f0cb4c9b11a3bf8209cc1a6d7017f5 not found: ID does not exist"
Jul 09 19:07:27.569372 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.569345    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"]
Jul 09 19:07:27.576236 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.576217    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a9f3f7be-openshift-default-bdf5c585f-mzn6h"]
Jul 09 19:07:27.639532 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:27.639499    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2baa4bea-ff1d-4c84-86d5-42afea7193df" path="/var/lib/kubelet/pods/2baa4bea-ff1d-4c84-86d5-42afea7193df/volumes"
Jul 09 19:07:28.160082 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:28.160034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:29.929067 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:29.929031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:30.028886 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:30.028846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:30.509443 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:30.509398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:30.533721 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:30.533687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:07:30.608854 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:07:30.608795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:02.040790 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:02.040729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:08.526551 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:08.526502    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:14.618428 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:14.618371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:14.688441 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:14.688370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:14.790889 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:14.790842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:14.890632 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:14.890561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:14.990176 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:14.990151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:15.396125 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:15.396092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:41.389446 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:41.389348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:48.208748 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:48.208713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:48.310538 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:48.310511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:48.406194 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:08:48.406170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:04.361892 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:04.361858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:10.430145 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:10.430105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:11.204282 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:11.204248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:11.309722 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:11.309690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:11.431634 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:11.431601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:21.978636 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:21.978601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:22.786326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:22.786296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:28.974737 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:28.974685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:29.082344 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:29.082319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:29.175073 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:29.175040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:29.275008 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:29.274947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:30.035828 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:30.035794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:30.135327 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:30.135298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:30.241743 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:30.241700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:31.000708 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:31.000651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:32.268246 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:32.268209    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:09:41.360528 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:09:41.360492    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:10:01.780894 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:01.780863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:04.211442 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:04.211410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:08.378052 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:08.377991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:14.361733 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:14.361692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:14.461368 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:14.461334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:20.529359 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:20.529317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:44.990833 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:44.990758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:51.165372 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:51.165343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:57.260572 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.260538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:57.362552 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.362522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:57.517686 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.517599    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:57.842683 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.842606    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"]
Jul 09 19:10:57.843139 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.843118    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2baa4bea-ff1d-4c84-86d5-42afea7193df" containerName="istio-proxy"
Jul 09 19:10:57.843139 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.843139    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2baa4bea-ff1d-4c84-86d5-42afea7193df" containerName="istio-proxy"
Jul 09 19:10:57.843278 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.843208    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2baa4bea-ff1d-4c84-86d5-42afea7193df" containerName="istio-proxy"
Jul 09 19:10:57.846290 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.846228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.849600 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.849580    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-98995b74-openshift-default-dockercfg-qhh6c\""
Jul 09 19:10:57.872273 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.872247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"]
Jul 09 19:10:57.877478 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.877458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:57.958068 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrhq\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-kube-api-access-msrhq\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958243 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-data\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958243 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b2197b-b07c-411a-b445-47680fa1d2cf-istiod-ca-cert\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958243 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-socket\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958427 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-envoy\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958427 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-certs\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958427 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-token\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958539 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-credential-socket\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.958539 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.958460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-podinfo\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:57.980560 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:57.980529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:58.058938 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.058907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-socket\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.058982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-envoy\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-certs\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-token\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-credential-socket\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-podinfo\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059406 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrhq\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-kube-api-access-msrhq\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059406 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-data\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059406 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b2197b-b07c-411a-b445-47680fa1d2cf-istiod-ca-cert\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059569 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-socket\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059569 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-certs\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059569 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-credential-socket\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.059721 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-data\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.060024 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.059984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b2197b-b07c-411a-b445-47680fa1d2cf-istiod-ca-cert\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.062129 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.062103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-envoy\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.062455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.062437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-podinfo\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.070904 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.070884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-token\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.071092 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.071072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrhq\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-kube-api-access-msrhq\") pod \"e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") " pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.156295 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.156229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:58.298196 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.298172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"]
Jul 09 19:10:58.300318 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:10:58.300284    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b2197b_b07c_411a_b445_47680fa1d2cf.slice/crio-5c24fab175945ac452ab549199d984a35b15f246995169ad1c07d8db799ab25c WatchSource:0}: Error finding container 5c24fab175945ac452ab549199d984a35b15f246995169ad1c07d8db799ab25c: Status 404 returned error can't find the container with id 5c24fab175945ac452ab549199d984a35b15f246995169ad1c07d8db799ab25c
Jul 09 19:10:58.302714 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.302685    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:10:58.302803 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.302745    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:10:58.302803 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.302778    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:10:58.587956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.587920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" event={"ID":"26b2197b-b07c-411a-b445-47680fa1d2cf","Type":"ContainerStarted","Data":"5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"}
Jul 09 19:10:58.588130 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.587977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" event={"ID":"26b2197b-b07c-411a-b445-47680fa1d2cf","Type":"ContainerStarted","Data":"5c24fab175945ac452ab549199d984a35b15f246995169ad1c07d8db799ab25c"}
Jul 09 19:10:58.610469 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:58.610424    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podStartSLOduration=1.610408346 podStartE2EDuration="1.610408346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:10:58.609714795 +0000 UTC m=+1771.418561231" watchObservedRunningTime="2026-07-09 19:10:58.610408346 +0000 UTC m=+1771.419254772"
Jul 09 19:10:59.157233 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:59.157192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:59.162337 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:59.162314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:59.593877 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:59.593845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:10:59.595076 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:10:59.595054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:11:00.599143 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:00.599104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:00.701191 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:00.701157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:00.759826 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:00.759788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:11:00.839818 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:00.839775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:00.943833 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:00.943788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:01.377485 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:01.377357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:01.477019 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:01.476987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:05.150084 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:05.150044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:05.829664 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:05.829620    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:05.925055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:05.925025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:06.293261 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:06.293225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:11.658991 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:11.658957    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:11:12.972736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:12.972677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:13.110080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:13.110028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:13.470502 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:13.470465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:13.823368 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:13.823266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:13.947793 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:13.947752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:15.233285 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.231915    2578 patch_prober.go:28] interesting pod/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:55286->10.134.0.45:15021: read: connection reset by peer" start-of-body=
Jul 09 19:11:15.233285 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.232011    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:55286->10.134.0.45:15021: read: connection reset by peer"
Jul 09 19:11:15.679069 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.679037    2578 generic.go:356] "Generic (PLEG): container finished" podID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerID="5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00" exitCode=0
Jul 09 19:11:15.679233 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.679107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" event={"ID":"26b2197b-b07c-411a-b445-47680fa1d2cf","Type":"ContainerDied","Data":"5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"}
Jul 09 19:11:15.679571 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.679555    2578 scope.go:117] "RemoveContainer" containerID="5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"
Jul 09 19:11:15.680601 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.680576    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:15.680676 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.680659    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:15.680717 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:15.680700    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:16.686105 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:16.686070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" event={"ID":"26b2197b-b07c-411a-b445-47680fa1d2cf","Type":"ContainerStarted","Data":"d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3"}
Jul 09 19:11:17.156968 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:17.156869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:11:17.157117 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:17.157076    2578 patch_prober.go:28] interesting pod/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:11:17.157159 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:17.157126    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 19:11:18.157545 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:18.157510    2578 patch_prober.go:28] interesting pod/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:11:18.157908 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:18.157565    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 19:11:18.564221 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:18.564137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:11:19.156772 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:19.156735    2578 patch_prober.go:28] interesting pod/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:11:19.156963 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:19.156789    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 19:11:20.156956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.156920    2578 patch_prober.go:28] interesting pod/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:11:20.157365 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.156986    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 09 19:11:20.287970 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.287935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:20.387533 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.387498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:20.532367 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.532336    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"]
Jul 09 19:11:20.532798 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.532768    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy" containerID="cri-o://d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3" gracePeriod=30
Jul 09 19:11:20.563904 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.563860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:20.797816 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.797721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:20.908969 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:20.908930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:21.009562 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:21.009523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:21.137035 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:21.136938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:25.993559 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:25.993536    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:11:26.120462 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-envoy\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120462 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120424    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-socket\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120462 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-certs\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120487    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-podinfo\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-data\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120565    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-token\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120620    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-credential-socket\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120670    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msrhq\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-kube-api-access-msrhq\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.120705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120702    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b2197b-b07c-411a-b445-47680fa1d2cf-istiod-ca-cert\") pod \"26b2197b-b07c-411a-b445-47680fa1d2cf\" (UID: \"26b2197b-b07c-411a-b445-47680fa1d2cf\") "
Jul 09 19:11:26.121005 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:26.121005 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.120745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:26.121343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.121004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:26.121343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.121020    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.121343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.121040    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.121544 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.121344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26b2197b-b07c-411a-b445-47680fa1d2cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:11:26.121613 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.121444    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:26.122841 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.122815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:11:26.122958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.122877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:11:26.123391 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.123356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-kube-api-access-msrhq" (OuterVolumeSpecName: "kube-api-access-msrhq") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "kube-api-access-msrhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:26.123481 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.123401    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "26b2197b-b07c-411a-b445-47680fa1d2cf" (UID: "26b2197b-b07c-411a-b445-47680fa1d2cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:26.221478 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221454    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.221478 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221475    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.221623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221484    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.221623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221493    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.221623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221502    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msrhq\" (UniqueName: \"kubernetes.io/projected/26b2197b-b07c-411a-b445-47680fa1d2cf-kube-api-access-msrhq\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.221623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221510    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b2197b-b07c-411a-b445-47680fa1d2cf-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.221623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.221518    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b2197b-b07c-411a-b445-47680fa1d2cf-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:11:26.748720 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.748686    2578 generic.go:356] "Generic (PLEG): container finished" podID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerID="d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3" exitCode=0
Jul 09 19:11:26.748720 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.748723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" event={"ID":"26b2197b-b07c-411a-b445-47680fa1d2cf","Type":"ContainerDied","Data":"d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3"}
Jul 09 19:11:26.748923 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.748734    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"
Jul 09 19:11:26.748923 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.748761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl" event={"ID":"26b2197b-b07c-411a-b445-47680fa1d2cf","Type":"ContainerDied","Data":"5c24fab175945ac452ab549199d984a35b15f246995169ad1c07d8db799ab25c"}
Jul 09 19:11:26.748923 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.748781    2578 scope.go:117] "RemoveContainer" containerID="d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3"
Jul 09 19:11:26.758331 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.758307    2578 scope.go:117] "RemoveContainer" containerID="5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"
Jul 09 19:11:26.766179 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.766160    2578 scope.go:117] "RemoveContainer" containerID="d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3"
Jul 09 19:11:26.766426 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:11:26.766407    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3\": container with ID starting with d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3 not found: ID does not exist" containerID="d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3"
Jul 09 19:11:26.766491 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.766435    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3"} err="failed to get container status \"d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3\": rpc error: code = NotFound desc = could not find container \"d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3\": container with ID starting with d9089a2f874409c453f74cc97e8603dc13ff9c4e3413ebd6d1b5366e395db7c3 not found: ID does not exist"
Jul 09 19:11:26.766491 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.766451    2578 scope.go:117] "RemoveContainer" containerID="5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"
Jul 09 19:11:26.766710 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:11:26.766692    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00\": container with ID starting with 5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00 not found: ID does not exist" containerID="5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"
Jul 09 19:11:26.766751 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.766716    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00"} err="failed to get container status \"5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00\": rpc error: code = NotFound desc = could not find container \"5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00\": container with ID starting with 5d252254cedeea8fdf2cc383544e66ffc2ed005fe20d5dfbc7796a7e60e3db00 not found: ID does not exist"
Jul 09 19:11:26.773146 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.773127    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"]
Jul 09 19:11:26.778557 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:26.778536    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-98995b74-openshift-default-7c576dc7f9-scnxl"]
Jul 09 19:11:27.451259 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.451227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:27.596791 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.596766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:27.639529 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.639501    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" path="/var/lib/kubelet/pods/26b2197b-b07c-411a-b445-47680fa1d2cf/volumes"
Jul 09 19:11:27.687514 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.687492    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:11:27.694106 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.694083    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:11:27.694788 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.694760    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:11:27.700649 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.700634    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:11:27.707482 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.707424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:27.896834 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:27.896807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:34.278183 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:34.278130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:34.353315 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:34.353290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:41.103551 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.103509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:41.452043 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452006    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"]
Jul 09 19:11:41.452456 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452441    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy"
Jul 09 19:11:41.452515 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452457    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy"
Jul 09 19:11:41.452515 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452472    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy"
Jul 09 19:11:41.452515 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452477    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy"
Jul 09 19:11:41.452612 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452555    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy"
Jul 09 19:11:41.452612 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.452564    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b2197b-b07c-411a-b445-47680fa1d2cf" containerName="istio-proxy"
Jul 09 19:11:41.455671 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.455652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.461238 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.461216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9cef6b5e-openshift-default-dockercfg-4ns68\""
Jul 09 19:11:41.508200 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.508171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:41.530575 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.530549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"]
Jul 09 19:11:41.553658 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-istio-token\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553767 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc5292c-6367-4884-85dc-7b755b52df46-istio-podinfo\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553767 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-credential-socket\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553855 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkc2\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-kube-api-access-ntkc2\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553855 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-envoy\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553931 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-certs\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553931 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-socket\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.553931 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-data\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.554046 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.553943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc5292c-6367-4884-85dc-7b755b52df46-istiod-ca-cert\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654319 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-certs\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654467 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-socket\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654467 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-data\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654467 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc5292c-6367-4884-85dc-7b755b52df46-istiod-ca-cert\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-istio-token\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc5292c-6367-4884-85dc-7b755b52df46-istio-podinfo\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-credential-socket\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkc2\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-kube-api-access-ntkc2\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654705 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-envoy\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-certs\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-socket\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.654958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.654937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-credential-socket\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.655108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.655059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-data\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.655249 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.655227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc5292c-6367-4884-85dc-7b755b52df46-istiod-ca-cert\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.657012 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.656990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-envoy\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.657281 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.657263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc5292c-6367-4884-85dc-7b755b52df46-istio-podinfo\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.665450 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.665425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkc2\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-kube-api-access-ntkc2\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.665773 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.665753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-istio-token\") pod \"e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") " pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.766588 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.766530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:41.913577 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.913549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"]
Jul 09 19:11:41.914488 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:11:41.914463    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc5292c_6367_4884_85dc_7b755b52df46.slice/crio-84d14072539bf349d6e19c322d0986cd0e7fa3e246328eb9ce5648cf0303c5d1 WatchSource:0}: Error finding container 84d14072539bf349d6e19c322d0986cd0e7fa3e246328eb9ce5648cf0303c5d1: Status 404 returned error can't find the container with id 84d14072539bf349d6e19c322d0986cd0e7fa3e246328eb9ce5648cf0303c5d1
Jul 09 19:11:41.916935 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.916900    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:41.917040 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.917016    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:41.917110 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.917063    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:41.970298 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:41.970270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:42.842057 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:42.842023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" event={"ID":"3cc5292c-6367-4884-85dc-7b755b52df46","Type":"ContainerStarted","Data":"a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"}
Jul 09 19:11:42.842447 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:42.842083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" event={"ID":"3cc5292c-6367-4884-85dc-7b755b52df46","Type":"ContainerStarted","Data":"84d14072539bf349d6e19c322d0986cd0e7fa3e246328eb9ce5648cf0303c5d1"}
Jul 09 19:11:42.869113 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:42.869069    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" podStartSLOduration=1.869053406 podStartE2EDuration="1.869053406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:42.865956789 +0000 UTC m=+1815.674803226" watchObservedRunningTime="2026-07-09 19:11:42.869053406 +0000 UTC m=+1815.677899840"
Jul 09 19:11:43.767215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:43.767180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:43.771834 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:43.771810    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:43.846701 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:43.846675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:43.847541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:43.847525    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:11:44.771171 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:44.771137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:44.868782 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:44.868740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:44.934294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:44.934266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:45.103814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:45.103729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:45.445038 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:45.445005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:45.546728 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:45.546701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:49.283894 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:49.283857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:50.259199 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:50.259166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:11:53.366529 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.366494    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"]
Jul 09 19:11:53.370342 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.370324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.376009 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.375986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9cef6b5e\"/\"e2e-lifecycle-model-9cef6b5e-kserve-self-signed-certs\""
Jul 09 19:11:53.376009 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.375998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9cef6b5e\"/\"openshift-service-ca.crt\""
Jul 09 19:11:53.376195 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.375986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9cef6b5e\"/\"default-dockercfg-gj4sr\""
Jul 09 19:11:53.376195 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.376047    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9cef6b5e\"/\"kube-root-ca.crt\""
Jul 09 19:11:53.381298 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.381276    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"]
Jul 09 19:11:53.479923 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.479890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:53.559825 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.559792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tls-certs\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.559825 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.559825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn65g\" (UniqueName: \"kubernetes.io/projected/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-kube-api-access-hn65g\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.560037 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.559862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-dshm\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.560037 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.559982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-home\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.560037 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.560030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-model-cache\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.560147 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.560059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tmp-dir\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661474 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-dshm\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661474 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-home\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661710 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-model-cache\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661710 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tmp-dir\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661710 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tls-certs\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661710 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn65g\" (UniqueName: \"kubernetes.io/projected/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-kube-api-access-hn65g\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.661896 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.661877    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-home\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.662024 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.662002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tmp-dir\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.662024 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.662020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-model-cache\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.663865 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.663849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-dshm\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.664243 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.664222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tls-certs\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.674088 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.674067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn65g\" (UniqueName: \"kubernetes.io/projected/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-kube-api-access-hn65g\") pod \"e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") " pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.680953 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.680931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:11:53.876864 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.876840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"]
Jul 09 19:11:53.879431 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:11:53.879369    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf155f3a6_aa7a_48ba_b1e7_0cd22df4d328.slice/crio-631c6a06132bf312bb0e6808bc8161ac73e401b018e32ecd8569643254873f9c WatchSource:0}: Error finding container 631c6a06132bf312bb0e6808bc8161ac73e401b018e32ecd8569643254873f9c: Status 404 returned error can't find the container with id 631c6a06132bf312bb0e6808bc8161ac73e401b018e32ecd8569643254873f9c
Jul 09 19:11:53.915478 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:53.915413    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql" event={"ID":"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328","Type":"ContainerStarted","Data":"631c6a06132bf312bb0e6808bc8161ac73e401b018e32ecd8569643254873f9c"}
Jul 09 19:11:54.924412 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:54.921888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql" event={"ID":"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328","Type":"ContainerStarted","Data":"e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546"}
Jul 09 19:11:54.946340 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:54.946295    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql" podStartSLOduration=1.94628011 podStartE2EDuration="1.94628011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:11:54.945877189 +0000 UTC m=+1827.754723626" watchObservedRunningTime="2026-07-09 19:11:54.94628011 +0000 UTC m=+1827.755126544"
Jul 09 19:11:58.848163 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.848131    2578 patch_prober.go:28] interesting pod/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:11:58.848545 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.848188    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 09 19:11:58.944860 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.944834    2578 generic.go:356] "Generic (PLEG): container finished" podID="3cc5292c-6367-4884-85dc-7b755b52df46" containerID="a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68" exitCode=0
Jul 09 19:11:58.944985 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.944893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" event={"ID":"3cc5292c-6367-4884-85dc-7b755b52df46","Type":"ContainerDied","Data":"a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"}
Jul 09 19:11:58.945225 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.945211    2578 scope.go:117] "RemoveContainer" containerID="a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"
Jul 09 19:11:58.946159 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.946131    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:58.946226 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.946213    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:58.946266 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.946247    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:11:58.953911 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:58.953888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:11:59.951740 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:11:59.951708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" event={"ID":"3cc5292c-6367-4884-85dc-7b755b52df46","Type":"ContainerStarted","Data":"e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db"}
Jul 09 19:12:00.767243 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:00.767209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:12:00.767433 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:00.767402    2578 patch_prober.go:28] interesting pod/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:12:00.767483 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:00.767461    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 09 19:12:01.767272 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:01.767232    2578 patch_prober.go:28] interesting pod/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:12:01.767683 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:01.767293    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 09 19:12:02.767520 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:02.767482    2578 patch_prober.go:28] interesting pod/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:12:02.767883 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:02.767558    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 09 19:12:03.681769 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.681732    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:12:03.681947 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.681823    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:12:03.695423 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.695364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:12:03.771114 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.771088    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:12:03.771510 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.771331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:12:03.771971 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.771952    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:12:03.984266 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:03.984187    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:12:14.068408 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:14.068356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:12:16.728658 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:16.728622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:12:17.836553 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:17.836519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:12:22.837167 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:22.837137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:12:27.818338 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:27.818308    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"]
Jul 09 19:12:27.919171 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:27.919135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:12:29.353626 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:29.353592    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:12:42.838500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:42.838435    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql" podUID="f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" containerName="main" containerID="cri-o://e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546" gracePeriod=45
Jul 09 19:12:43.086107 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.086085    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:12:43.180007 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.179982    2578 generic.go:356] "Generic (PLEG): container finished" podID="f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" containerID="e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546" exitCode=0
Jul 09 19:12:43.180178 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.180028    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"
Jul 09 19:12:43.180178 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.180077    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql" event={"ID":"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328","Type":"ContainerDied","Data":"e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546"}
Jul 09 19:12:43.180178 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.180129    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql" event={"ID":"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328","Type":"ContainerDied","Data":"631c6a06132bf312bb0e6808bc8161ac73e401b018e32ecd8569643254873f9c"}
Jul 09 19:12:43.180178 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.180152    2578 scope.go:117] "RemoveContainer" containerID="e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546"
Jul 09 19:12:43.188617 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.188600    2578 scope.go:117] "RemoveContainer" containerID="e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546"
Jul 09 19:12:43.188878 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:12:43.188859    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546\": container with ID starting with e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546 not found: ID does not exist" containerID="e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546"
Jul 09 19:12:43.188932 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.188888    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546"} err="failed to get container status \"e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546\": rpc error: code = NotFound desc = could not find container \"e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546\": container with ID starting with e0158331d98f4da7eab45a82ca32ba3592f1b6a9d835c2627640cffff123d546 not found: ID does not exist"
Jul 09 19:12:43.197280 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-model-cache\") pod \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") "
Jul 09 19:12:43.197360 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tmp-dir\") pod \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") "
Jul 09 19:12:43.197360 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197339    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn65g\" (UniqueName: \"kubernetes.io/projected/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-kube-api-access-hn65g\") pod \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") "
Jul 09 19:12:43.197490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197395    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-home\") pod \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") "
Jul 09 19:12:43.197490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tls-certs\") pod \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") "
Jul 09 19:12:43.197490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197440    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-dshm\") pod \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\" (UID: \"f155f3a6-aa7a-48ba-b1e7-0cd22df4d328\") "
Jul 09 19:12:43.197649 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" (UID: "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:12:43.197689 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-model-cache" (OuterVolumeSpecName: "model-cache") pod "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" (UID: "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:12:43.197729 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-home" (OuterVolumeSpecName: "home") pod "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" (UID: "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:12:43.197891 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197875    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:12:43.197956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197894    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:12:43.197956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.197904    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:12:43.199651 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.199625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" (UID: "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:12:43.199723 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.199684    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-dshm" (OuterVolumeSpecName: "dshm") pod "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" (UID: "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:12:43.199723 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.199716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-kube-api-access-hn65g" (OuterVolumeSpecName: "kube-api-access-hn65g") pod "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" (UID: "f155f3a6-aa7a-48ba-b1e7-0cd22df4d328"). InnerVolumeSpecName "kube-api-access-hn65g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:12:43.298339 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.298313    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn65g\" (UniqueName: \"kubernetes.io/projected/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-kube-api-access-hn65g\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:12:43.298339 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.298337    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:12:43.298498 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.298350    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:12:43.507112 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.507086    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"]
Jul 09 19:12:43.512297 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.512273    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9cef6b5e/e2e-lifecycle-model-9cef6b5e-kserve-644d98fcd7-wwxql"]
Jul 09 19:12:43.640312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:12:43.640282    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" path="/var/lib/kubelet/pods/f155f3a6-aa7a-48ba-b1e7-0cd22df4d328/volumes"
Jul 09 19:13:13.584070 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:13.584033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:14.593685 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:14.593645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:17.097984 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:17.097947    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:13:17.791487 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:17.791452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:17.891740 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:17.891686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:21.044647 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:21.044608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:21.147882 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:21.147851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:21.309527 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:21.309456    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"]
Jul 09 19:13:21.309778 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:21.309747    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy" containerID="cri-o://e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db" gracePeriod=30
Jul 09 19:13:21.333419 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:21.333371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:21.585557 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:21.585474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:22.649460 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:22.649422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:22.748293 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:22.748258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:22.849268 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:22.849239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:23.603596 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:23.603565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:23.698599 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:23.698568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:23.798573 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:23.798549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:26.281825 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.281790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:13:26.571076 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.571053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:13:26.665373 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc5292c-6367-4884-85dc-7b755b52df46-istio-podinfo\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-credential-socket\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-socket\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665457    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-data\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665608 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665502    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc5292c-6367-4884-85dc-7b755b52df46-istiod-ca-cert\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665608 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-istio-token\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665608 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-envoy\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665754 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-certs\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665754 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665677    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntkc2\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-kube-api-access-ntkc2\") pod \"3cc5292c-6367-4884-85dc-7b755b52df46\" (UID: \"3cc5292c-6367-4884-85dc-7b755b52df46\") "
Jul 09 19:13:26.665857 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665756    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:13:26.665857 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.665788    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:13:26.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.666009    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:13:26.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.666013    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cc5292c-6367-4884-85dc-7b755b52df46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:13:26.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.666027    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.666047    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.666529 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.666493    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:13:26.667636 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.667613    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cc5292c-6367-4884-85dc-7b755b52df46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:13:26.667850 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.667829    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:13:26.668537 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.668518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-kube-api-access-ntkc2" (OuterVolumeSpecName: "kube-api-access-ntkc2") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "kube-api-access-ntkc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:13:26.668631 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.668557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cc5292c-6367-4884-85dc-7b755b52df46" (UID: "3cc5292c-6367-4884-85dc-7b755b52df46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:13:26.766883 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766853    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.766883 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766881    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntkc2\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-kube-api-access-ntkc2\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.767054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766896    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cc5292c-6367-4884-85dc-7b755b52df46-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.767054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766909    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.767054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766922    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cc5292c-6367-4884-85dc-7b755b52df46-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.767054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766935    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cc5292c-6367-4884-85dc-7b755b52df46-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:26.767054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:26.766947    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cc5292c-6367-4884-85dc-7b755b52df46-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:13:27.428661 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.428628    2578 generic.go:356] "Generic (PLEG): container finished" podID="3cc5292c-6367-4884-85dc-7b755b52df46" containerID="e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db" exitCode=0
Jul 09 19:13:27.429083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.428684    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"
Jul 09 19:13:27.429083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.428712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" event={"ID":"3cc5292c-6367-4884-85dc-7b755b52df46","Type":"ContainerDied","Data":"e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db"}
Jul 09 19:13:27.429083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.428765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8" event={"ID":"3cc5292c-6367-4884-85dc-7b755b52df46","Type":"ContainerDied","Data":"84d14072539bf349d6e19c322d0986cd0e7fa3e246328eb9ce5648cf0303c5d1"}
Jul 09 19:13:27.429083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.428786    2578 scope.go:117] "RemoveContainer" containerID="e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db"
Jul 09 19:13:27.438541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.438525    2578 scope.go:117] "RemoveContainer" containerID="a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"
Jul 09 19:13:27.446693 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.446674    2578 scope.go:117] "RemoveContainer" containerID="e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db"
Jul 09 19:13:27.446963 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:13:27.446945    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db\": container with ID starting with e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db not found: ID does not exist" containerID="e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db"
Jul 09 19:13:27.447010 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.446973    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db"} err="failed to get container status \"e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db\": rpc error: code = NotFound desc = could not find container \"e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db\": container with ID starting with e306fd2721edeb416da07dbffe5891e16e4ec629bc45ae62426a497e5fa271db not found: ID does not exist"
Jul 09 19:13:27.447010 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.446990    2578 scope.go:117] "RemoveContainer" containerID="a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"
Jul 09 19:13:27.447232 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:13:27.447215    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68\": container with ID starting with a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68 not found: ID does not exist" containerID="a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"
Jul 09 19:13:27.447280 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.447238    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68"} err="failed to get container status \"a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68\": rpc error: code = NotFound desc = could not find container \"a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68\": container with ID starting with a376b69af54dfc5b7787a95c283c26e7baa1667468f2c4cf8752206415385e68 not found: ID does not exist"
Jul 09 19:13:27.454427 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.454407    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"]
Jul 09 19:13:27.460916 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.460893    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9cef6b5e-openshift-default-645d7c865f-jc8l8"]
Jul 09 19:13:27.640654 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:27.640633    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" path="/var/lib/kubelet/pods/3cc5292c-6367-4884-85dc-7b755b52df46/volumes"
Jul 09 19:13:38.054012 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:38.053970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:13:55.086729 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:13:55.086694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:01.639326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:01.639291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:07.914788 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:07.914747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:08.010644 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:08.010606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:17.611246 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:17.611199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:17.672615 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:17.672588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:38.520038 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:38.519923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:44.838716 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:44.838675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:50.763580 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:50.763550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:50.863918 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:50.863890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:50.966270 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:50.966241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:14:52.957224 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:14:52.957190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:15:01.508256 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:01.508218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:01.873626 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:01.873528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:03.378619 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:03.378579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:03.474732 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:03.474700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:22.843413 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:22.843355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:25.276469 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:25.276371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:29.607208 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:29.607175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:29.707578 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:29.707546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:29.991468 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:29.991440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:30.314154 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314082    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"]
Jul 09 19:15:30.314534 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314519    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy"
Jul 09 19:15:30.314586 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314535    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy"
Jul 09 19:15:30.314586 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314548    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" containerName="main"
Jul 09 19:15:30.314586 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314553    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" containerName="main"
Jul 09 19:15:30.314691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314621    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy"
Jul 09 19:15:30.314691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314632    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy"
Jul 09 19:15:30.314691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.314640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f155f3a6-aa7a-48ba-b1e7-0cd22df4d328" containerName="main"
Jul 09 19:15:30.317609 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.317595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.321208 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.321177    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-575766-openshift-default-dockercfg-f8f5p\""
Jul 09 19:15:30.333083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.333063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"]
Jul 09 19:15:30.346054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.346034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:30.499536 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-data\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-credential-socket\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-envoy\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tclkn\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-kube-api-access-tclkn\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istiod-ca-cert\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499832 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-token\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499832 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-socket\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499832 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-podinfo\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.499937 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.499829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-certs\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.547295 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.547266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:30.601074 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.600998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-socket\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601074 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-podinfo\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601074 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-certs\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601334 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-data\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601334 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-credential-socket\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601334 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-envoy\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601334 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tclkn\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-kube-api-access-tclkn\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601334 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istiod-ca-cert\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601334 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-token\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-socket\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-certs\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-data\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.601642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.601618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-credential-socket\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.602017 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.602001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istiod-ca-cert\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.603536 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.603514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-envoy\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.603682 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.603665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-podinfo\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.610631 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.610608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-token\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.610946 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.610928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tclkn\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-kube-api-access-tclkn\") pod \"e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") " pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.627793 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.627773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:30.763264 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.763236    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"]
Jul 09 19:15:30.765149 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:15:30.765122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6d4a69_0383_4dbb_b653_e5f2b3bac32d.slice/crio-8d74c5d972c6092404c304ab61a8bef986da726f41bcbaa8028b6a6fe75fecef WatchSource:0}: Error finding container 8d74c5d972c6092404c304ab61a8bef986da726f41bcbaa8028b6a6fe75fecef: Status 404 returned error can't find the container with id 8d74c5d972c6092404c304ab61a8bef986da726f41bcbaa8028b6a6fe75fecef
Jul 09 19:15:30.767938 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.767907    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:30.768015 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.767976    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:30.768015 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:30.768004    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:31.063436 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:31.063401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" event={"ID":"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d","Type":"ContainerStarted","Data":"fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"}
Jul 09 19:15:31.063622 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:31.063455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" event={"ID":"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d","Type":"ContainerStarted","Data":"8d74c5d972c6092404c304ab61a8bef986da726f41bcbaa8028b6a6fe75fecef"}
Jul 09 19:15:31.089688 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:31.089632    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podStartSLOduration=1.089612526 podStartE2EDuration="1.089612526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:31.086751154 +0000 UTC m=+2043.895597587" watchObservedRunningTime="2026-07-09 19:15:31.089612526 +0000 UTC m=+2043.898458963"
Jul 09 19:15:31.628262 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:31.628235    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:31.632597 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:31.632570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:32.068656 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:32.068618    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:32.069572 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:32.069554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:33.060013 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:33.059979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:33.160826 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:33.160799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:33.318363 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:33.318285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:33.525069 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:33.525038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:33.865616 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:33.865587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:33.969946 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:33.969918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:37.549972 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:37.549939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:37.898280 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:37.898205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:38.180416 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.180371    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"]
Jul 09 19:15:38.180946 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.180925    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy"
Jul 09 19:15:38.180946 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.180947    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc5292c-6367-4884-85dc-7b755b52df46" containerName="istio-proxy"
Jul 09 19:15:38.184341 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.184320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.187752 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.187735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8d3645-openshift-default-dockercfg-mxv29\""
Jul 09 19:15:38.199091 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.199071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"]
Jul 09 19:15:38.218662 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.218640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:38.265453 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-podinfo\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-certs\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-envoy\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265615 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9hvg\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-kube-api-access-k9hvg\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265615 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b400b8-8209-4175-859c-99b51b8f9e9e-istiod-ca-cert\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-socket\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-credential-socket\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265742 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-data\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.265775 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.265746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-token\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.366910 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.366879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-podinfo\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.366910 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.366916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-certs\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.366944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-envoy\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.366967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9hvg\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-kube-api-access-k9hvg\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b400b8-8209-4175-859c-99b51b8f9e9e-istiod-ca-cert\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-socket\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-credential-socket\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-data\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367472 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-token\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367472 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-certs\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367472 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-credential-socket\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367621 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-socket\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367621 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-data\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.367850 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.367827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b400b8-8209-4175-859c-99b51b8f9e9e-istiod-ca-cert\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.369603 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.369581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-podinfo\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.369603 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.369595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-envoy\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.377520 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.377497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9hvg\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-kube-api-access-k9hvg\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.377520 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.377511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-token\") pod \"e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") " pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.496008 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.495951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:38.631246 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.631221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"]
Jul 09 19:15:38.633170 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:15:38.633127    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b400b8_8209_4175_859c_99b51b8f9e9e.slice/crio-064cc36cb9f64ba891f2caf2db423545b641095d5748b7be9ce592e9b9139d90 WatchSource:0}: Error finding container 064cc36cb9f64ba891f2caf2db423545b641095d5748b7be9ce592e9b9139d90: Status 404 returned error can't find the container with id 064cc36cb9f64ba891f2caf2db423545b641095d5748b7be9ce592e9b9139d90
Jul 09 19:15:38.635707 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.635676    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:38.635792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.635739    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:38.635792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.635766    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:38.704268 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:38.704240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:39.106948 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:39.106916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" event={"ID":"e2b400b8-8209-4175-859c-99b51b8f9e9e","Type":"ContainerStarted","Data":"4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"}
Jul 09 19:15:39.107129 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:39.106964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" event={"ID":"e2b400b8-8209-4175-859c-99b51b8f9e9e","Type":"ContainerStarted","Data":"064cc36cb9f64ba891f2caf2db423545b641095d5748b7be9ce592e9b9139d90"}
Jul 09 19:15:39.145336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:39.145290    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podStartSLOduration=1.145274709 podStartE2EDuration="1.145274709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:39.144282688 +0000 UTC m=+2051.953129124" watchObservedRunningTime="2026-07-09 19:15:39.145274709 +0000 UTC m=+2051.954121142"
Jul 09 19:15:39.496146 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:39.496112    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:39.500921 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:39.500901    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:40.112502 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:40.112475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:40.113352 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:40.113332    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:40.654984 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:40.654957    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:15:41.070614 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:41.070580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:41.172522 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:41.172471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:41.271960 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:41.271926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:41.409489 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:41.409369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:41.709374 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:41.709254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:41.808312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:41.808278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:45.563130 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:45.563084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:48.111549 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:48.111511    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 19:15:48.111962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:48.111572    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 19:15:49.164286 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:49.164251    2578 generic.go:356] "Generic (PLEG): container finished" podID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerID="fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e" exitCode=0
Jul 09 19:15:49.164736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:49.164323    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" event={"ID":"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d","Type":"ContainerDied","Data":"fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"}
Jul 09 19:15:49.164818 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:49.164804    2578 scope.go:117] "RemoveContainer" containerID="fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"
Jul 09 19:15:49.165854 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:49.165825    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:49.165951 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:49.165893    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:49.165951 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:49.165925    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:50.171951 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:50.171913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" event={"ID":"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d","Type":"ContainerStarted","Data":"a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602"}
Jul 09 19:15:50.628404 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:50.628277    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:50.628779 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:50.628680    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:15:50.628960 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:50.628936    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 09 19:15:51.629137 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:51.628683    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:15:51.629137 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:51.628745    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 09 19:15:52.152596 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:52.152560    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:15:52.628157 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:52.628124    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:15:52.628311 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:52.628186    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 09 19:15:53.628279 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:53.628245    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:15:53.628827 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:53.628301    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 09 19:15:54.628784 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:54.628740    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:15:54.629316 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:54.628802    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 09 19:15:54.703600 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:54.703567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:54.804466 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:54.804434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:55.632346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:55.632316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:55.632810 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:55.632687    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:55.633500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:55.633482    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:15:55.846887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:55.846600    2578 patch_prober.go:28] interesting pod/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:51162->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Jul 09 19:15:55.846887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:55.846672    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:51162->10.134.0.49:15021: read: connection reset by peer"
Jul 09 19:15:56.213362 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:56.213332    2578 generic.go:356] "Generic (PLEG): container finished" podID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerID="4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d" exitCode=0
Jul 09 19:15:56.213497 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:56.213407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" event={"ID":"e2b400b8-8209-4175-859c-99b51b8f9e9e","Type":"ContainerDied","Data":"4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"}
Jul 09 19:15:56.213779 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:56.213764    2578 scope.go:117] "RemoveContainer" containerID="4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"
Jul 09 19:15:56.214631 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:56.214608    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:56.214694 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:56.214672    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:56.214729 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:56.214704    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:15:57.224918 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:57.224884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" event={"ID":"e2b400b8-8209-4175-859c-99b51b8f9e9e","Type":"ContainerStarted","Data":"da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b"}
Jul 09 19:15:57.496936 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:57.496842    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:15:57.497586 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:57.496916    2578 patch_prober.go:28] interesting pod/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 09 19:15:57.497586 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:57.497308    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 09 19:15:58.497315 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:58.497270    2578 patch_prober.go:28] interesting pod/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 09 19:15:58.497790 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:58.497336    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 09 19:15:59.207773 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:59.207741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:59.496912 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:59.496815    2578 patch_prober.go:28] interesting pod/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 09 19:15:59.496912 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:15:59.496884    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 09 19:16:00.497262 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:00.497225    2578 patch_prober.go:28] interesting pod/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 09 19:16:00.497827 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:00.497793    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 09 19:16:01.499593 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:01.499565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:16:01.499949 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:01.499882    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:16:01.500696 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:01.500680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:16:02.688442 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:02.688412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:02.787109 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:02.787083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:05.162157 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:05.162122    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:16:18.503034 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:18.502993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:26.958765 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:26.958723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:16:27.721245 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:27.721220    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:16:27.727851 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:27.727828    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:16:27.729139 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:27.729119    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:16:27.735805 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:27.735788    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:16:38.530917 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:38.530885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:38.877520 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:38.877435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:39.080343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:39.080298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:47.440880 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:47.440839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:47.555501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:47.555470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:47.640285 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:47.640245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:47.739789 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:47.739691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:48.132340 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:48.132263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:48.234553 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:48.234524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:51.900961 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:51.900926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:16:54.350999 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:54.350960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:16:57.483694 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:16:57.483662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:17:03.866900 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.866870    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"]
Jul 09 19:17:03.870444 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.870426    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:03.878745 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.878248    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"default-dockercfg-8cbtb\""
Jul 09 19:17:03.878745 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.878310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"test-model-8e4d4c-kserve-self-signed-certs\""
Jul 09 19:17:03.878745 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.878459    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"openshift-service-ca.crt\""
Jul 09 19:17:03.883403 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.879694    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"kube-root-ca.crt\""
Jul 09 19:17:03.892188 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.892157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"]
Jul 09 19:17:03.911416 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:03.911389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:17:04.038165 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.038125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-model-cache\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.038349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.038180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrqj\" (UniqueName: \"kubernetes.io/projected/c89198e4-3532-4282-9d7a-a056b4a233fb-kube-api-access-5wrqj\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.038349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.038240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-home\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.038349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.038317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-tmp-dir\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.038519 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.038372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-dshm\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.038519 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.038420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c89198e4-3532-4282-9d7a-a056b4a233fb-tls-certs\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.139759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.139658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-tmp-dir\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.139759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.139726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-dshm\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.139759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.139743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c89198e4-3532-4282-9d7a-a056b4a233fb-tls-certs\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.140066 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.139770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-model-cache\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.140066 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.139803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrqj\" (UniqueName: \"kubernetes.io/projected/c89198e4-3532-4282-9d7a-a056b4a233fb-kube-api-access-5wrqj\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.140066 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.139824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-home\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.140228 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.140151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-tmp-dir\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.140228 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.140168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-model-cache\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.140330 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.140225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-home\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.142279 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.142248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-dshm\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.142437 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.142421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c89198e4-3532-4282-9d7a-a056b4a233fb-tls-certs\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.152672 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.152647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrqj\" (UniqueName: \"kubernetes.io/projected/c89198e4-3532-4282-9d7a-a056b4a233fb-kube-api-access-5wrqj\") pod \"test-model-8e4d4c-kserve-57bb6c8949-z2l57\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.181703 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.181661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:04.334512 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.334477    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"]
Jul 09 19:17:04.337844 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:17:04.337816    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc89198e4_3532_4282_9d7a_a056b4a233fb.slice/crio-95138c9d3823647f2e80200cbac3f90c2fbbde273c9370d0d9b0dc38f4c18c2f WatchSource:0}: Error finding container 95138c9d3823647f2e80200cbac3f90c2fbbde273c9370d0d9b0dc38f4c18c2f: Status 404 returned error can't find the container with id 95138c9d3823647f2e80200cbac3f90c2fbbde273c9370d0d9b0dc38f4c18c2f
Jul 09 19:17:04.558255 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.558222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57" event={"ID":"c89198e4-3532-4282-9d7a-a056b4a233fb","Type":"ContainerStarted","Data":"06b4f84735866b2a75cb09a872f7e5a67c5024d33514b9bc7c6d2ebad3102f0c"}
Jul 09 19:17:04.558470 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.558265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57" event={"ID":"c89198e4-3532-4282-9d7a-a056b4a233fb","Type":"ContainerStarted","Data":"95138c9d3823647f2e80200cbac3f90c2fbbde273c9370d0d9b0dc38f4c18c2f"}
Jul 09 19:17:04.585802 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:04.585746    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57" podStartSLOduration=1.585729659 podStartE2EDuration="1.585729659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:17:04.583289716 +0000 UTC m=+2137.392136143" watchObservedRunningTime="2026-07-09 19:17:04.585729659 +0000 UTC m=+2137.394576093"
Jul 09 19:17:14.182548 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:14.182515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:14.183047 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:14.182562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:14.195116 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:14.195092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:14.621661 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:14.621583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:14.863391 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:14.863341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:17:28.248633 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:28.248547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:17:28.580664 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:28.580571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:17:28.757788 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:28.757754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:17:33.541107 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:33.541068    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"]
Jul 09 19:17:33.635226 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:33.635195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:17:34.261744 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:34.261713    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:17:48.562671 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.562630    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57" podUID="c89198e4-3532-4282-9d7a-a056b4a233fb" containerName="main" containerID="cri-o://06b4f84735866b2a75cb09a872f7e5a67c5024d33514b9bc7c6d2ebad3102f0c" gracePeriod=45
Jul 09 19:17:48.799224 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.799198    2578 generic.go:356] "Generic (PLEG): container finished" podID="c89198e4-3532-4282-9d7a-a056b4a233fb" containerID="06b4f84735866b2a75cb09a872f7e5a67c5024d33514b9bc7c6d2ebad3102f0c" exitCode=0
Jul 09 19:17:48.799336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.799258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57" event={"ID":"c89198e4-3532-4282-9d7a-a056b4a233fb","Type":"ContainerDied","Data":"06b4f84735866b2a75cb09a872f7e5a67c5024d33514b9bc7c6d2ebad3102f0c"}
Jul 09 19:17:48.799336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.799285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57" event={"ID":"c89198e4-3532-4282-9d7a-a056b4a233fb","Type":"ContainerDied","Data":"95138c9d3823647f2e80200cbac3f90c2fbbde273c9370d0d9b0dc38f4c18c2f"}
Jul 09 19:17:48.799336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.799296    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95138c9d3823647f2e80200cbac3f90c2fbbde273c9370d0d9b0dc38f4c18c2f"
Jul 09 19:17:48.812718 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.812664    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:48.934815 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.934789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c89198e4-3532-4282-9d7a-a056b4a233fb-tls-certs\") pod \"c89198e4-3532-4282-9d7a-a056b4a233fb\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") "
Jul 09 19:17:48.934966 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.934832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-dshm\") pod \"c89198e4-3532-4282-9d7a-a056b4a233fb\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") "
Jul 09 19:17:48.934966 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.934855    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-model-cache\") pod \"c89198e4-3532-4282-9d7a-a056b4a233fb\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") "
Jul 09 19:17:48.934966 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.934938    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-tmp-dir\") pod \"c89198e4-3532-4282-9d7a-a056b4a233fb\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") "
Jul 09 19:17:48.935136 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.934966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-home\") pod \"c89198e4-3532-4282-9d7a-a056b4a233fb\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") "
Jul 09 19:17:48.935136 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrqj\" (UniqueName: \"kubernetes.io/projected/c89198e4-3532-4282-9d7a-a056b4a233fb-kube-api-access-5wrqj\") pod \"c89198e4-3532-4282-9d7a-a056b4a233fb\" (UID: \"c89198e4-3532-4282-9d7a-a056b4a233fb\") "
Jul 09 19:17:48.935271 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935181    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "c89198e4-3532-4282-9d7a-a056b4a233fb" (UID: "c89198e4-3532-4282-9d7a-a056b4a233fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:17:48.935271 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935203    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c89198e4-3532-4282-9d7a-a056b4a233fb" (UID: "c89198e4-3532-4282-9d7a-a056b4a233fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:17:48.935271 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-home" (OuterVolumeSpecName: "home") pod "c89198e4-3532-4282-9d7a-a056b4a233fb" (UID: "c89198e4-3532-4282-9d7a-a056b4a233fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:17:48.935582 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935521    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:17:48.935582 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935539    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:17:48.935582 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.935548    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:17:48.937221 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.937198    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c89198e4-3532-4282-9d7a-a056b4a233fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c89198e4-3532-4282-9d7a-a056b4a233fb" (UID: "c89198e4-3532-4282-9d7a-a056b4a233fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:17:48.937314 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.937226    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-dshm" (OuterVolumeSpecName: "dshm") pod "c89198e4-3532-4282-9d7a-a056b4a233fb" (UID: "c89198e4-3532-4282-9d7a-a056b4a233fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:17:48.937314 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:48.937308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c89198e4-3532-4282-9d7a-a056b4a233fb-kube-api-access-5wrqj" (OuterVolumeSpecName: "kube-api-access-5wrqj") pod "c89198e4-3532-4282-9d7a-a056b4a233fb" (UID: "c89198e4-3532-4282-9d7a-a056b4a233fb"). InnerVolumeSpecName "kube-api-access-5wrqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:17:49.036228 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:49.036203    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrqj\" (UniqueName: \"kubernetes.io/projected/c89198e4-3532-4282-9d7a-a056b4a233fb-kube-api-access-5wrqj\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:17:49.036228 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:49.036225    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c89198e4-3532-4282-9d7a-a056b4a233fb-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:17:49.036411 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:49.036234    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c89198e4-3532-4282-9d7a-a056b4a233fb-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:17:49.804042 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:49.804006    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"
Jul 09 19:17:49.826480 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:49.826451    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"]
Jul 09 19:17:49.831552 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:49.831526    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-z2l57"]
Jul 09 19:17:51.640839 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:17:51.640804    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c89198e4-3532-4282-9d7a-a056b4a233fb" path="/var/lib/kubelet/pods/c89198e4-3532-4282-9d7a-a056b4a233fb/volumes"
Jul 09 19:18:10.079317 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:10.079280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:11.421911 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:11.421876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:15.757335 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:15.757300    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:18:17.786302 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:17.786272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:17.886318 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:17.886285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:18.106421 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:18.106297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:18.356373 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:18.356335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:18.718002 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:18.717944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:19.072452 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:19.072347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:19.270908 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:19.270874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:21.036517 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:21.036483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:21.136564 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:21.136537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:21.370667 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:21.370590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:21.525925 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:21.525894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:25.557295 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:25.557244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:31.053318 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.053281    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"]
Jul 09 19:18:31.053783 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.053767    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89198e4-3532-4282-9d7a-a056b4a233fb" containerName="main"
Jul 09 19:18:31.053783 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.053784    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89198e4-3532-4282-9d7a-a056b4a233fb" containerName="main"
Jul 09 19:18:31.053884 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.053874    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c89198e4-3532-4282-9d7a-a056b4a233fb" containerName="main"
Jul 09 19:18:31.057291 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.057273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.062399 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.062357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"openshift-service-ca.crt\""
Jul 09 19:18:31.064687 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.064269    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"kube-root-ca.crt\""
Jul 09 19:18:31.064687 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.064291    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"default-dockercfg-wqfms\""
Jul 09 19:18:31.065211 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.064915    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-8e4d4c\"/\"test-model-8e4d4c-kserve-self-signed-certs\""
Jul 09 19:18:31.067399 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.067358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"]
Jul 09 19:18:31.080232 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.080198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:31.197584 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.197559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-tmp-dir\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.197678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.197604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-model-cache\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.197678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.197632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbmkx\" (UniqueName: \"kubernetes.io/projected/a99be5b1-9b01-42f7-b935-1065d2f1a635-kube-api-access-tbmkx\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.197759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.197676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99be5b1-9b01-42f7-b935-1065d2f1a635-tls-certs\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.197759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.197698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-home\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.197759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.197717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-dshm\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298446 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-model-cache\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298640 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbmkx\" (UniqueName: \"kubernetes.io/projected/a99be5b1-9b01-42f7-b935-1065d2f1a635-kube-api-access-tbmkx\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298640 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99be5b1-9b01-42f7-b935-1065d2f1a635-tls-certs\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298640 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-home\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298640 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-dshm\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298831 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-tmp-dir\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298902 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-model-cache\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.298943 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.298916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-home\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.299038 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.299020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-tmp-dir\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.300996 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.300977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-dshm\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.301208 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.301191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99be5b1-9b01-42f7-b935-1065d2f1a635-tls-certs\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.309159 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.309098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbmkx\" (UniqueName: \"kubernetes.io/projected/a99be5b1-9b01-42f7-b935-1065d2f1a635-kube-api-access-tbmkx\") pod \"test-model-8e4d4c-kserve-57bb6c8949-5lp8l\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") " pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.368328 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.368309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:31.517285 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:31.517261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"]
Jul 09 19:18:31.518464 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:18:31.518436    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda99be5b1_9b01_42f7_b935_1065d2f1a635.slice/crio-04e7899d5afdd0593322d573c42f7dc22ba96684184c461ca2d207532aecb59d WatchSource:0}: Error finding container 04e7899d5afdd0593322d573c42f7dc22ba96684184c461ca2d207532aecb59d: Status 404 returned error can't find the container with id 04e7899d5afdd0593322d573c42f7dc22ba96684184c461ca2d207532aecb59d
Jul 09 19:18:32.057432 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:32.057402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l" event={"ID":"a99be5b1-9b01-42f7-b935-1065d2f1a635","Type":"ContainerStarted","Data":"4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9"}
Jul 09 19:18:32.057781 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:32.057442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l" event={"ID":"a99be5b1-9b01-42f7-b935-1065d2f1a635","Type":"ContainerStarted","Data":"04e7899d5afdd0593322d573c42f7dc22ba96684184c461ca2d207532aecb59d"}
Jul 09 19:18:32.079750 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:32.079705    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l" podStartSLOduration=1.079690501 podStartE2EDuration="1.079690501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:18:32.078310823 +0000 UTC m=+2224.887157259" watchObservedRunningTime="2026-07-09 19:18:32.079690501 +0000 UTC m=+2224.888536935"
Jul 09 19:18:41.369331 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:41.369297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:41.369730 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:41.369348    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:41.381731 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:41.381703    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:18:42.060079 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:42.060040    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:18:42.118832 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:18:42.118808    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:19:02.552917 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:02.552881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:02.650041 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:02.650008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:02.978619 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:02.978588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:07.960245 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:07.960211    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"]
Jul 09 19:19:08.045322 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:08.045293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:13.854914 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:13.854882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:19:22.980789 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:22.980743    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l" podUID="a99be5b1-9b01-42f7-b935-1065d2f1a635" containerName="main" containerID="cri-o://4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9" gracePeriod=45
Jul 09 19:19:23.231755 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.231696    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:19:23.319198 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbmkx\" (UniqueName: \"kubernetes.io/projected/a99be5b1-9b01-42f7-b935-1065d2f1a635-kube-api-access-tbmkx\") pod \"a99be5b1-9b01-42f7-b935-1065d2f1a635\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") "
Jul 09 19:19:23.319346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319256    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-home\") pod \"a99be5b1-9b01-42f7-b935-1065d2f1a635\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") "
Jul 09 19:19:23.319346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-tmp-dir\") pod \"a99be5b1-9b01-42f7-b935-1065d2f1a635\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") "
Jul 09 19:19:23.319346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-dshm\") pod \"a99be5b1-9b01-42f7-b935-1065d2f1a635\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") "
Jul 09 19:19:23.319542 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99be5b1-9b01-42f7-b935-1065d2f1a635-tls-certs\") pod \"a99be5b1-9b01-42f7-b935-1065d2f1a635\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") "
Jul 09 19:19:23.319542 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-model-cache\") pod \"a99be5b1-9b01-42f7-b935-1065d2f1a635\" (UID: \"a99be5b1-9b01-42f7-b935-1065d2f1a635\") "
Jul 09 19:19:23.319645 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a99be5b1-9b01-42f7-b935-1065d2f1a635" (UID: "a99be5b1-9b01-42f7-b935-1065d2f1a635"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:23.319645 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-home" (OuterVolumeSpecName: "home") pod "a99be5b1-9b01-42f7-b935-1065d2f1a635" (UID: "a99be5b1-9b01-42f7-b935-1065d2f1a635"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:23.319790 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319761    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-model-cache" (OuterVolumeSpecName: "model-cache") pod "a99be5b1-9b01-42f7-b935-1065d2f1a635" (UID: "a99be5b1-9b01-42f7-b935-1065d2f1a635"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:23.319885 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319864    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:19:23.319885 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319883    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:19:23.320014 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.319891    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:19:23.321706 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.321681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a99be5b1-9b01-42f7-b935-1065d2f1a635-kube-api-access-tbmkx" (OuterVolumeSpecName: "kube-api-access-tbmkx") pod "a99be5b1-9b01-42f7-b935-1065d2f1a635" (UID: "a99be5b1-9b01-42f7-b935-1065d2f1a635"). InnerVolumeSpecName "kube-api-access-tbmkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:19:23.321823 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.321763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a99be5b1-9b01-42f7-b935-1065d2f1a635-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a99be5b1-9b01-42f7-b935-1065d2f1a635" (UID: "a99be5b1-9b01-42f7-b935-1065d2f1a635"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:19:23.321823 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.321797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-dshm" (OuterVolumeSpecName: "dshm") pod "a99be5b1-9b01-42f7-b935-1065d2f1a635" (UID: "a99be5b1-9b01-42f7-b935-1065d2f1a635"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:19:23.328245 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.328221    2578 generic.go:356] "Generic (PLEG): container finished" podID="a99be5b1-9b01-42f7-b935-1065d2f1a635" containerID="4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9" exitCode=0
Jul 09 19:19:23.328359 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.328293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l" event={"ID":"a99be5b1-9b01-42f7-b935-1065d2f1a635","Type":"ContainerDied","Data":"4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9"}
Jul 09 19:19:23.328359 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.328339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l" event={"ID":"a99be5b1-9b01-42f7-b935-1065d2f1a635","Type":"ContainerDied","Data":"04e7899d5afdd0593322d573c42f7dc22ba96684184c461ca2d207532aecb59d"}
Jul 09 19:19:23.328359 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.328339    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"
Jul 09 19:19:23.328359 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.328353    2578 scope.go:117] "RemoveContainer" containerID="4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9"
Jul 09 19:19:23.342679 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.342662    2578 scope.go:117] "RemoveContainer" containerID="4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9"
Jul 09 19:19:23.342921 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:19:23.342905    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9\": container with ID starting with 4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9 not found: ID does not exist" containerID="4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9"
Jul 09 19:19:23.342967 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.342931    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9"} err="failed to get container status \"4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9\": rpc error: code = NotFound desc = could not find container \"4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9\": container with ID starting with 4c8edb0b9a4f10a036c7503b4d207bd4c875691c7386f8f7a4db9ac3fba8fbe9 not found: ID does not exist"
Jul 09 19:19:23.367787 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.367769    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"]
Jul 09 19:19:23.371884 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.371865    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-8e4d4c/test-model-8e4d4c-kserve-57bb6c8949-5lp8l"]
Jul 09 19:19:23.421205 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.421182    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbmkx\" (UniqueName: \"kubernetes.io/projected/a99be5b1-9b01-42f7-b935-1065d2f1a635-kube-api-access-tbmkx\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:19:23.421294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.421210    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99be5b1-9b01-42f7-b935-1065d2f1a635-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:19:23.421294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.421223    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99be5b1-9b01-42f7-b935-1065d2f1a635-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:19:23.646495 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:23.646439    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a99be5b1-9b01-42f7-b935-1065d2f1a635" path="/var/lib/kubelet/pods/a99be5b1-9b01-42f7-b935-1065d2f1a635/volumes"
Jul 09 19:19:24.733869 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:24.733837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:44.604640 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:44.604606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:45.879332 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:45.879288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:46.989057 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:46.989004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:47.083978 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:47.083948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:19:48.757771 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:48.757743    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:19:51.872569 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:19:51.872530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:04.206193 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:04.206164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:04.302331 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:04.302255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:07.382650 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:07.382614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:07.459338 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:07.459306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:07.670342 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:07.670314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:07.946259 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:07.946143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:08.900459 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:08.900425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:09.894799 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:09.894757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:10.052690 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:10.052657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:10.438135 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:10.438095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:10.538814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:10.538785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:10.639199 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:10.639174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:10.858433 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:10.858333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:15.506962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:15.506927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:15.957083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:15.957053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:20:53.125315 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:53.125286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:53.374933 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:53.374900    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"]
Jul 09 19:20:53.375142 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:53.375119    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" containerID="cri-o://a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602" gracePeriod=30
Jul 09 19:20:54.368905 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:54.368866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:54.482489 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:54.482465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:54.583578 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:54.583548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:54.791510 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:54.791470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:55.634939 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:55.634903    2578 patch_prober.go:28] interesting pod/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 19:20:55.635312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:55.634965    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:20:57.252708 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:57.252674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:20:58.632789 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.632767    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:20:58.664843 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.664783    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-podinfo\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.664843 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.664828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-token\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665034 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.664952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istiod-ca-cert\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665034 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.664991    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-envoy\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665148 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665059    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-credential-socket\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665148 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-socket\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665252 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665155    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tclkn\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-kube-api-access-tclkn\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665252 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-data\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665355 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:58.665431 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665363    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-certs\") pod \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\" (UID: \"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d\") "
Jul 09 19:20:58.665496 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665432    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:58.665496 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:20:58.665917 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665694    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:58.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.665876    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.666001    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.666016    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.666055 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.666029    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.666288 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.666241    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:58.667528 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.667502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:20:58.667633 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.667507    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:20:58.667770 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.667752    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:58.667835 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.667807    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-kube-api-access-tclkn" (OuterVolumeSpecName: "kube-api-access-tclkn") pod "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" (UID: "5b6d4a69-0383-4dbb-b653-e5f2b3bac32d"). InnerVolumeSpecName "kube-api-access-tclkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:20:58.767053 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.767013    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.767053 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.767048    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tclkn\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-kube-api-access-tclkn\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.767053 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.767062    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.767230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.767074    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.767230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.767085    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:20:58.823304 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.823278    2578 generic.go:356] "Generic (PLEG): container finished" podID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerID="a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602" exitCode=0
Jul 09 19:20:58.823432 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.823310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" event={"ID":"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d","Type":"ContainerDied","Data":"a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602"}
Jul 09 19:20:58.823432 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.823331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"
Jul 09 19:20:58.823432 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.823347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf" event={"ID":"5b6d4a69-0383-4dbb-b653-e5f2b3bac32d","Type":"ContainerDied","Data":"8d74c5d972c6092404c304ab61a8bef986da726f41bcbaa8028b6a6fe75fecef"}
Jul 09 19:20:58.823432 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.823368    2578 scope.go:117] "RemoveContainer" containerID="a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602"
Jul 09 19:20:58.833208 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.833189    2578 scope.go:117] "RemoveContainer" containerID="fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"
Jul 09 19:20:58.841648 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.841631    2578 scope.go:117] "RemoveContainer" containerID="a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602"
Jul 09 19:20:58.841900 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:20:58.841883    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602\": container with ID starting with a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602 not found: ID does not exist" containerID="a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602"
Jul 09 19:20:58.841958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.841906    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602"} err="failed to get container status \"a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602\": rpc error: code = NotFound desc = could not find container \"a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602\": container with ID starting with a77f5135110fa8021744cc2667031383acff502ecc42e64e98447cb3fba73602 not found: ID does not exist"
Jul 09 19:20:58.841958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.841931    2578 scope.go:117] "RemoveContainer" containerID="fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"
Jul 09 19:20:58.842166 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:20:58.842148    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e\": container with ID starting with fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e not found: ID does not exist" containerID="fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"
Jul 09 19:20:58.842207 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.842174    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e"} err="failed to get container status \"fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e\": rpc error: code = NotFound desc = could not find container \"fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e\": container with ID starting with fc5bf5119891fe944b3967faa2323114dcbcfa845c8512f8b491bf295bea3e3e not found: ID does not exist"
Jul 09 19:20:58.847824 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.847801    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"]
Jul 09 19:20:58.851929 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:58.851906    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-575766-openshift-default-5c9b8dd64f-jt2bf"]
Jul 09 19:20:59.640268 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:20:59.640233    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" path="/var/lib/kubelet/pods/5b6d4a69-0383-4dbb-b653-e5f2b3bac32d/volumes"
Jul 09 19:21:00.716428 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:00.716373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:00.807411 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:00.807351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:00.990119 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:00.990041    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"]
Jul 09 19:21:00.990304 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:00.990281    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" containerID="cri-o://da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b" gracePeriod=30
Jul 09 19:21:01.017233 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:01.017203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:01.231756 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:01.231726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:01.502205 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:01.502176    2578 patch_prober.go:28] interesting pod/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 19:21:01.502349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:01.502243    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:21:01.589074 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:01.589044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:01.917141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:01.917035    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:02.239740 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:02.239709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:04.603628 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:04.603584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:04.723613 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:04.723581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:04.850683 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:04.850647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:04.982433 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:04.982366    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:05.450343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:05.450310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:05.564246 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:05.564211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:06.244555 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.244533    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:21:06.343181 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-token\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343181 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9hvg\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-kube-api-access-k9hvg\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343218    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b400b8-8209-4175-859c-99b51b8f9e9e-istiod-ca-cert\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-certs\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-podinfo\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343513 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-credential-socket\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343513 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343404    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-data\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343513 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343472    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-envoy\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343659 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343525    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-socket\") pod \"e2b400b8-8209-4175-859c-99b51b8f9e9e\" (UID: \"e2b400b8-8209-4175-859c-99b51b8f9e9e\") "
Jul 09 19:21:06.343659 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:06.343659 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343619    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:06.343818 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343685    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b400b8-8209-4175-859c-99b51b8f9e9e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:21:06.344031 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.343998    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2b400b8-8209-4175-859c-99b51b8f9e9e-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.344031 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.344022    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.344346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.344042    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.344346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.344105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:06.344490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.344431    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:06.345489 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.345466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:06.345896 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.345877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-kube-api-access-k9hvg" (OuterVolumeSpecName: "kube-api-access-k9hvg") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "kube-api-access-k9hvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:06.345987 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.345974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:06.346029 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.345998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2b400b8-8209-4175-859c-99b51b8f9e9e" (UID: "e2b400b8-8209-4175-859c-99b51b8f9e9e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:21:06.445257 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.445225    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.445257 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.445252    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.445418 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.445265    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.445418 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.445276    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2b400b8-8209-4175-859c-99b51b8f9e9e-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.445418 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.445288    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.445418 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.445300    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9hvg\" (UniqueName: \"kubernetes.io/projected/e2b400b8-8209-4175-859c-99b51b8f9e9e-kube-api-access-k9hvg\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:06.866517 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.866485    2578 generic.go:356] "Generic (PLEG): container finished" podID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerID="da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b" exitCode=0
Jul 09 19:21:06.866637 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.866535    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"
Jul 09 19:21:06.866637 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.866567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" event={"ID":"e2b400b8-8209-4175-859c-99b51b8f9e9e","Type":"ContainerDied","Data":"da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b"}
Jul 09 19:21:06.866637 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.866624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf" event={"ID":"e2b400b8-8209-4175-859c-99b51b8f9e9e","Type":"ContainerDied","Data":"064cc36cb9f64ba891f2caf2db423545b641095d5748b7be9ce592e9b9139d90"}
Jul 09 19:21:06.866754 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.866647    2578 scope.go:117] "RemoveContainer" containerID="da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b"
Jul 09 19:21:06.875918 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.875903    2578 scope.go:117] "RemoveContainer" containerID="4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"
Jul 09 19:21:06.884085 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.884066    2578 scope.go:117] "RemoveContainer" containerID="da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b"
Jul 09 19:21:06.884337 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:21:06.884318    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b\": container with ID starting with da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b not found: ID does not exist" containerID="da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b"
Jul 09 19:21:06.884526 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.884348    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b"} err="failed to get container status \"da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b\": rpc error: code = NotFound desc = could not find container \"da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b\": container with ID starting with da1684b3715d2b88978596bed9c01bfce7a50201f1b092fb1eccf1ca60b7186b not found: ID does not exist"
Jul 09 19:21:06.884526 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.884373    2578 scope.go:117] "RemoveContainer" containerID="4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"
Jul 09 19:21:06.884668 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:21:06.884651    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d\": container with ID starting with 4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d not found: ID does not exist" containerID="4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"
Jul 09 19:21:06.884707 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.884673    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d"} err="failed to get container status \"4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d\": rpc error: code = NotFound desc = could not find container \"4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d\": container with ID starting with 4729d07d9fdcae1bf26651cb6b81636dde337fa1ed35e09fed1bba268e33451d not found: ID does not exist"
Jul 09 19:21:06.891698 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.891674    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"]
Jul 09 19:21:06.897088 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:06.897068    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8d3645-openshift-default-7cc65bfc5f-7ktxf"]
Jul 09 19:21:07.640537 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:07.640507    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" path="/var/lib/kubelet/pods/e2b400b8-8209-4175-859c-99b51b8f9e9e/volumes"
Jul 09 19:21:09.150297 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.150266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:09.628756 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.628722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:09.943671 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.943637    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"]
Jul 09 19:21:09.944135 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944116    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy"
Jul 09 19:21:09.944135 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944136    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944147    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a99be5b1-9b01-42f7-b935-1065d2f1a635" containerName="main"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944155    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a99be5b1-9b01-42f7-b935-1065d2f1a635" containerName="main"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944172    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944180    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944192    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944199    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944228    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy"
Jul 09 19:21:09.944326 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944235    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy"
Jul 09 19:21:09.944736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944340    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy"
Jul 09 19:21:09.944736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944354    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a99be5b1-9b01-42f7-b935-1065d2f1a635" containerName="main"
Jul 09 19:21:09.944736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944365    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy"
Jul 09 19:21:09.944736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944394    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b400b8-8209-4175-859c-99b51b8f9e9e" containerName="istio-proxy"
Jul 09 19:21:09.944736 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.944406    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6d4a69-0383-4dbb-b653-e5f2b3bac32d" containerName="istio-proxy"
Jul 09 19:21:09.947830 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.947809    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:09.951294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.951275    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0bfb2e-openshift-default-dockercfg-rm6xh\""
Jul 09 19:21:09.960251 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.960232    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"]
Jul 09 19:21:09.972649 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:09.972630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:10.073455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxd6\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-kube-api-access-pzxd6\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073609 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-credential-socket\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073609 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-envoy\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073715 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-certs\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073715 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-data\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-podinfo\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0d46ee-c536-400f-9be9-9bc474c730bb-istiod-ca-cert\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073907 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-socket\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.073907 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.073866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-token\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175081 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-certs\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-data\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-podinfo\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0d46ee-c536-400f-9be9-9bc474c730bb-istiod-ca-cert\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-socket\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-token\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxd6\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-kube-api-access-pzxd6\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-credential-socket\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175888 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-certs\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175888 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-envoy\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.175888 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-data\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.176112 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.175918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-credential-socket\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.176215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.176190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-socket\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.176471 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.176452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0d46ee-c536-400f-9be9-9bc474c730bb-istiod-ca-cert\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.178043 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.178021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-envoy\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.178697 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.178679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-podinfo\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.185808 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.185781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-token\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.185889 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.185850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxd6\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-kube-api-access-pzxd6\") pod \"e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") " pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.213213 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.213162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:10.259313 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.259288    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:10.399832 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.399805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"]
Jul 09 19:21:10.405831 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:21:10.405775    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0d46ee_c536_400f_9be9_9bc474c730bb.slice/crio-aeeea6e5dee54a1edeec1b91099e96d23d9d98f480f223f533ba8d6a0b9633f4 WatchSource:0}: Error finding container aeeea6e5dee54a1edeec1b91099e96d23d9d98f480f223f533ba8d6a0b9633f4: Status 404 returned error can't find the container with id aeeea6e5dee54a1edeec1b91099e96d23d9d98f480f223f533ba8d6a0b9633f4
Jul 09 19:21:10.407761 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.407717    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:21:10.407853 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.407804    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:21:10.407895 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.407848    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:21:10.888678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.888600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" event={"ID":"cc0d46ee-c536-400f-9be9-9bc474c730bb","Type":"ContainerStarted","Data":"788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"}
Jul 09 19:21:10.888678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.888653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" event={"ID":"cc0d46ee-c536-400f-9be9-9bc474c730bb","Type":"ContainerStarted","Data":"aeeea6e5dee54a1edeec1b91099e96d23d9d98f480f223f533ba8d6a0b9633f4"}
Jul 09 19:21:10.912327 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:10.912284    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" podStartSLOduration=1.912268039 podStartE2EDuration="1.912268039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:10.911197214 +0000 UTC m=+2383.720043649" watchObservedRunningTime="2026-07-09 19:21:10.912268039 +0000 UTC m=+2383.721114473"
Jul 09 19:21:11.259986 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:11.259957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:11.264746 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:11.264722    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:11.894345 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:11.894313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:11.895317 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:11.895299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:12.756336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:12.756305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:21:12.878019 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:12.877987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:12.969416 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:12.969365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:13.083110 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:13.083045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:13.453659 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:13.453627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:13.668731 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:13.668705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:13.769600 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:13.769532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:17.408554 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:17.408513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:25.751559 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:25.751520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:26.060422 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:26.060293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:26.160285 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:26.160250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:26.239528 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:26.239496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:26.445206 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:26.445173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:27.755922 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:27.755892    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:21:27.763857 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:27.763789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:21:27.766100 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:27.766079    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:21:27.772862 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:27.772844    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:21:29.949938 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:29.949903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:21:30.994541 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:30.994509    2578 generic.go:356] "Generic (PLEG): container finished" podID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerID="788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592" exitCode=0
Jul 09 19:21:30.994933 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:30.994557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" event={"ID":"cc0d46ee-c536-400f-9be9-9bc474c730bb","Type":"ContainerDied","Data":"788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"}
Jul 09 19:21:30.994933 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:30.994880    2578 scope.go:117] "RemoveContainer" containerID="788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"
Jul 09 19:21:30.995840 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:30.995809    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:21:30.995946 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:30.995893    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:21:30.995946 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:30.995940    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 09 19:21:32.004880 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.004838    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" event={"ID":"cc0d46ee-c536-400f-9be9-9bc474c730bb","Type":"ContainerStarted","Data":"0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd"}
Jul 09 19:21:32.259866 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.259772    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:32.260028 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.259992    2578 patch_prober.go:28] interesting pod/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 09 19:21:32.260093 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.260047    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 09 19:21:32.497800 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.497719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:32.597338 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.597245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:32.760573 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:32.760545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:33.000314 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.000236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:33.197568 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.197534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:33.260603 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.260530    2578 patch_prober.go:28] interesting pod/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 09 19:21:33.260603 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.260584    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 09 19:21:33.554811 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.554719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:33.653366 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.653329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:33.752491 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.752456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:33.950730 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:33.950687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:34.259891 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:34.259802    2578 patch_prober.go:28] interesting pod/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 09 19:21:34.259891 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:34.259874    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 09 19:21:35.260188 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:35.260152    2578 patch_prober.go:28] interesting pod/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 09 19:21:35.260610 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:35.260223    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 09 19:21:36.263338 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:36.263309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:36.263796 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:36.263738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:36.264357 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:36.264339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:40.241227 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:40.241188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:40.341583 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:40.341552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:40.484910 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:40.484877    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"]
Jul 09 19:21:40.485122 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:40.485100    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy" containerID="cri-o://0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd" gracePeriod=30
Jul 09 19:21:40.516668 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:40.516575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:40.738396 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:40.738339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:41.117809 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:41.117778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:41.422993 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:41.422949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:41.515309 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:41.515286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:41.787938 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:41.787849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:41.888677 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:41.888654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:43.260780 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:43.260746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:21:44.914001 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:44.913963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:45.030789 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.030761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:45.137790 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.137759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:45.339230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.339200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:45.634033 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.634007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:45.734044 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.734011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:45.749759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.749737    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:45.804788 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.804565    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-credential-socket\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805000 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.804968    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:45.805146 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805025    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxd6\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-kube-api-access-pzxd6\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805146 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-podinfo\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805146 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-data\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0d46ee-c536-400f-9be9-9bc474c730bb-istiod-ca-cert\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805205    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-token\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-envoy\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805265    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-socket\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.805333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.805310    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-certs\") pod \"cc0d46ee-c536-400f-9be9-9bc474c730bb\" (UID: \"cc0d46ee-c536-400f-9be9-9bc474c730bb\") "
Jul 09 19:21:45.806507 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.806229    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:45.806507 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.806262    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:45.806662 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.806609    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0d46ee-c536-400f-9be9-9bc474c730bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:21:45.808544 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.808522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:45.808849 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.808811    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:21:45.808996 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.808963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:45.809759 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.809718    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-kube-api-access-pzxd6" (OuterVolumeSpecName: "kube-api-access-pzxd6") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "kube-api-access-pzxd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:45.811153 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.811104    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc0d46ee-c536-400f-9be9-9bc474c730bb" (UID: "cc0d46ee-c536-400f-9be9-9bc474c730bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:45.906500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906449    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0d46ee-c536-400f-9be9-9bc474c730bb-istiod-ca-cert\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906470    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-token\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906479    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-envoy\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906486    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906494    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-workload-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906502    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-credential-socket\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906727 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906510    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxd6\" (UniqueName: \"kubernetes.io/projected/cc0d46ee-c536-400f-9be9-9bc474c730bb-kube-api-access-pzxd6\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906727 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906519    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-podinfo\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:45.906727 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:45.906527    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0d46ee-c536-400f-9be9-9bc474c730bb-istio-data\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:21:46.084679 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.084648    2578 generic.go:356] "Generic (PLEG): container finished" podID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerID="0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd" exitCode=0
Jul 09 19:21:46.084962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.084711    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"
Jul 09 19:21:46.084962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.084711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" event={"ID":"cc0d46ee-c536-400f-9be9-9bc474c730bb","Type":"ContainerDied","Data":"0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd"}
Jul 09 19:21:46.084962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.084855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw" event={"ID":"cc0d46ee-c536-400f-9be9-9bc474c730bb","Type":"ContainerDied","Data":"aeeea6e5dee54a1edeec1b91099e96d23d9d98f480f223f533ba8d6a0b9633f4"}
Jul 09 19:21:46.084962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.084884    2578 scope.go:117] "RemoveContainer" containerID="0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd"
Jul 09 19:21:46.094277 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.094259    2578 scope.go:117] "RemoveContainer" containerID="788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"
Jul 09 19:21:46.102078 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.102060    2578 scope.go:117] "RemoveContainer" containerID="0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd"
Jul 09 19:21:46.102324 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:21:46.102304    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd\": container with ID starting with 0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd not found: ID does not exist" containerID="0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd"
Jul 09 19:21:46.102423 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.102331    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd"} err="failed to get container status \"0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd\": rpc error: code = NotFound desc = could not find container \"0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd\": container with ID starting with 0a8ae3ec868f2b3201af0b23d0ee03bbee2bd31c97dee08d95181bf56e8494cd not found: ID does not exist"
Jul 09 19:21:46.102423 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.102346    2578 scope.go:117] "RemoveContainer" containerID="788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"
Jul 09 19:21:46.102609 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:21:46.102592    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592\": container with ID starting with 788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592 not found: ID does not exist" containerID="788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"
Jul 09 19:21:46.102659 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.102618    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592"} err="failed to get container status \"788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592\": rpc error: code = NotFound desc = could not find container \"788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592\": container with ID starting with 788cd7882d70135c27e7fd39518beee9e2d224072318b177d56ea16eafe38592 not found: ID does not exist"
Jul 09 19:21:46.114519 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.114496    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"]
Jul 09 19:21:46.123599 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:46.123573    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0bfb2e-openshift-default-6549c97d7-2pcgw"]
Jul 09 19:21:47.639891 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:47.639855    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" path="/var/lib/kubelet/pods/cc0d46ee-c536-400f-9be9-9bc474c730bb/volumes"
Jul 09 19:21:47.751213 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:47.751184    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:21:49.335969 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:49.335877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:49.668420 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:49.668324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:50.007951 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:50.007916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:50.312553 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:50.312468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:52.949980 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:52.949946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:53.030943 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:53.030915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:53.107563 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:53.107538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:53.598927 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:53.598895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:53.751681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:53.751655    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:53.848422 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:53.848371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:57.478640 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:57.478596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:21:57.669299 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:21:57.669265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:22:07.700926 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:07.700894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:07.799924 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:07.799891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:11.175698 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.175660    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"]
Jul 09 19:22:11.176357 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.176334    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy"
Jul 09 19:22:11.176446 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.176363    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy"
Jul 09 19:22:11.176539 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.176523    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy"
Jul 09 19:22:11.176576 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.176545    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy"
Jul 09 19:22:11.180222 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.180201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.185622 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.185600    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"default-dockercfg-bhkft\""
Jul 09 19:22:11.185622 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.185610    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"openshift-service-ca.crt\""
Jul 09 19:22:11.186142 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.186118    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"auth-test-model-18e258-kserve-self-signed-certs\""
Jul 09 19:22:11.186142 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.186138    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"kube-root-ca.crt\""
Jul 09 19:22:11.188949 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.188923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"]
Jul 09 19:22:11.215610 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.215583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:11.322752 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.322730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsw49\" (UniqueName: \"kubernetes.io/projected/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-kube-api-access-zsw49\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.322843 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.322778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-home\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.322843 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.322832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-model-cache\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.322924 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.322898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tls-certs\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.322959 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.322927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-dshm\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.322994 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.322975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tmp-dir\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423328 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-dshm\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423451 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tmp-dir\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423451 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsw49\" (UniqueName: \"kubernetes.io/projected/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-kube-api-access-zsw49\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423451 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-home\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423451 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-model-cache\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423614 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tls-certs\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423801 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tmp-dir\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423871 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-home\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.423871 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.423840    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-model-cache\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.425820 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.425766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-dshm\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.426229 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.426209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tls-certs\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.436360 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.436325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsw49\" (UniqueName: \"kubernetes.io/projected/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-kube-api-access-zsw49\") pod \"auth-test-model-18e258-kserve-699488f9f5-4qfj4\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") " pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.491421 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.491398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:11.626641 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:11.626611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"]
Jul 09 19:22:11.628001 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:22:11.627972    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeebd5a76_15f8_46a0_b7bc_b7f5d6299917.slice/crio-1251a22189c5714cc462cf22d46a0fc311bb6fad502fbd8f6197bb7da046eb54 WatchSource:0}: Error finding container 1251a22189c5714cc462cf22d46a0fc311bb6fad502fbd8f6197bb7da046eb54: Status 404 returned error can't find the container with id 1251a22189c5714cc462cf22d46a0fc311bb6fad502fbd8f6197bb7da046eb54
Jul 09 19:22:12.225771 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:12.225739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4" event={"ID":"eebd5a76-15f8-46a0-b7bc-b7f5d6299917","Type":"ContainerStarted","Data":"d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a"}
Jul 09 19:22:12.226199 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:12.225786    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4" event={"ID":"eebd5a76-15f8-46a0-b7bc-b7f5d6299917","Type":"ContainerStarted","Data":"1251a22189c5714cc462cf22d46a0fc311bb6fad502fbd8f6197bb7da046eb54"}
Jul 09 19:22:12.247967 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:12.247921    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4" podStartSLOduration=1.247906211 podStartE2EDuration="1.247906211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:22:12.246532657 +0000 UTC m=+2445.055379093" watchObservedRunningTime="2026-07-09 19:22:12.247906211 +0000 UTC m=+2445.056752643"
Jul 09 19:22:15.613569 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:15.613525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:15.710556 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:15.710522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:17.108881 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:17.108847    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:22:21.492402 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:21.492352    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:21.492822 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:21.492421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:21.505223 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:21.505183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:22.290950 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:22.290919    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:22:31.050144 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.050107    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"]
Jul 09 19:22:31.050743 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.050721    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy"
Jul 09 19:22:31.050836 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.050747    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0d46ee-c536-400f-9be9-9bc474c730bb" containerName="istio-proxy"
Jul 09 19:22:31.055306 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.055273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.059083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.059062    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"openshift-service-ca.crt\""
Jul 09 19:22:31.061113 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.061074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"default-dockercfg-lpq9l\""
Jul 09 19:22:31.061238 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.061093    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"auth-test-model-2ac82b-kserve-self-signed-certs\""
Jul 09 19:22:31.061238 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.061096    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"kube-root-ca.crt\""
Jul 09 19:22:31.065514 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.065495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"]
Jul 09 19:22:31.087058 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.087029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:31.092215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.092195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-tmp-dir\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.092278 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.092233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-home\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.092323 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.092306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ecca21-3c9f-489a-871b-a3474743dfd9-tls-certs\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.092369 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.092358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-dshm\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.092448 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.092404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-model-cache\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.092484 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.092446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqmnc\" (UniqueName: \"kubernetes.io/projected/b2ecca21-3c9f-489a-871b-a3474743dfd9-kube-api-access-tqmnc\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193215 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqmnc\" (UniqueName: \"kubernetes.io/projected/b2ecca21-3c9f-489a-871b-a3474743dfd9-kube-api-access-tqmnc\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193313 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-tmp-dir\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193313 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-home\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193313 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ecca21-3c9f-489a-871b-a3474743dfd9-tls-certs\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193457 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-dshm\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193457 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-model-cache\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193684 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-tmp-dir\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193751 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-model-cache\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.193751 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.193744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-home\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.195785 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.195762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-dshm\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.195939 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.195922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ecca21-3c9f-489a-871b-a3474743dfd9-tls-certs\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.203702 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.203682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqmnc\" (UniqueName: \"kubernetes.io/projected/b2ecca21-3c9f-489a-871b-a3474743dfd9-kube-api-access-tqmnc\") pod \"auth-test-model-2ac82b-kserve-79764ff9ff-6lcck\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") " pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.366141 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.366072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:31.501427 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:31.501399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"]
Jul 09 19:22:31.502785 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:22:31.502759    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ecca21_3c9f_489a_871b_a3474743dfd9.slice/crio-15cd7b5764da5f60575f850b868eceda1c73df1303bda27c1028419a4e9088cc WatchSource:0}: Error finding container 15cd7b5764da5f60575f850b868eceda1c73df1303bda27c1028419a4e9088cc: Status 404 returned error can't find the container with id 15cd7b5764da5f60575f850b868eceda1c73df1303bda27c1028419a4e9088cc
Jul 09 19:22:32.334842 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:32.334799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck" event={"ID":"b2ecca21-3c9f-489a-871b-a3474743dfd9","Type":"ContainerStarted","Data":"a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4"}
Jul 09 19:22:32.335229 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:32.334860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck" event={"ID":"b2ecca21-3c9f-489a-871b-a3474743dfd9","Type":"ContainerStarted","Data":"15cd7b5764da5f60575f850b868eceda1c73df1303bda27c1028419a4e9088cc"}
Jul 09 19:22:32.357221 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:32.357176    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck" podStartSLOduration=1.357161943 podStartE2EDuration="1.357161943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:22:32.355698528 +0000 UTC m=+2465.164544964" watchObservedRunningTime="2026-07-09 19:22:32.357161943 +0000 UTC m=+2465.166008378"
Jul 09 19:22:34.862642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:34.862607    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:22:41.366275 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:41.366239    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:41.366668 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:41.366297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:41.378964 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:41.378940    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:41.391417 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:41.391392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:22:49.055292 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:22:49.055253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:23:07.347455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:07.347410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:23:14.292993 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:14.292948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:23:23.259396 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:23.259237    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:23:27.852395 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:27.852353    2578 scope.go:117] "RemoveContainer" containerID="06b4f84735866b2a75cb09a872f7e5a67c5024d33514b9bc7c6d2ebad3102f0c"
Jul 09 19:23:40.655402 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:40.655290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:23:46.784810 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:46.784767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:23:58.447396 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:23:58.447344    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:24:11.166703 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:11.166659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:14.558280 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:14.558242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:24:29.530892 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:29.530855    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"]
Jul 09 19:24:29.549715 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:29.549681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:30.370887 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:30.370856    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"]
Jul 09 19:24:30.380467 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:30.380439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:32.648678 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.648631    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:24:32.660481 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.660443    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"]
Jul 09 19:24:32.664267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.664245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.667823 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.667802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"sub-test-model-18e258-kserve-self-signed-certs\""
Jul 09 19:24:32.672471 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.672446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"]
Jul 09 19:24:32.687554 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.687520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:32.825642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.825598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-tmp-dir\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.825804 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.825645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5wrb\" (UniqueName: \"kubernetes.io/projected/beecd774-a40d-4f1d-9455-5cd079b06f49-kube-api-access-h5wrb\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.825804 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.825745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-model-cache\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.825943 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.825842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-dshm\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.825943 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.825906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-home\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.826230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.825939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beecd774-a40d-4f1d-9455-5cd079b06f49-tls-certs\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.926914 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.926891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-tmp-dir\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927028 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.926923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5wrb\" (UniqueName: \"kubernetes.io/projected/beecd774-a40d-4f1d-9455-5cd079b06f49-kube-api-access-h5wrb\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927028 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.926943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-model-cache\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927028 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.926964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-dshm\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927028 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.926992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-home\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927204 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.927125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beecd774-a40d-4f1d-9455-5cd079b06f49-tls-certs\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927307 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.927277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-tmp-dir\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927469 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.927316    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-home\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.927469 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.927364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-model-cache\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.929360 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.929333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-dshm\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.929709 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.929689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beecd774-a40d-4f1d-9455-5cd079b06f49-tls-certs\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.938830 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.938808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5wrb\" (UniqueName: \"kubernetes.io/projected/beecd774-a40d-4f1d-9455-5cd079b06f49-kube-api-access-h5wrb\") pod \"sub-test-model-18e258-kserve-6f5fdf4b65-tkklr\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") " pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:32.975540 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:32.975521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:33.115151 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:33.115121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"]
Jul 09 19:24:33.116991 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:24:33.116947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeecd774_a40d_4f1d_9455_5cd079b06f49.slice/crio-df080a1d462aa8285104e6c24102519acbcb75f4170d78796cdd2009588313bb WatchSource:0}: Error finding container df080a1d462aa8285104e6c24102519acbcb75f4170d78796cdd2009588313bb: Status 404 returned error can't find the container with id df080a1d462aa8285104e6c24102519acbcb75f4170d78796cdd2009588313bb
Jul 09 19:24:33.976874 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:33.976830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr" event={"ID":"beecd774-a40d-4f1d-9455-5cd079b06f49","Type":"ContainerStarted","Data":"cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c"}
Jul 09 19:24:33.977210 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:33.976881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr" event={"ID":"beecd774-a40d-4f1d-9455-5cd079b06f49","Type":"ContainerStarted","Data":"df080a1d462aa8285104e6c24102519acbcb75f4170d78796cdd2009588313bb"}
Jul 09 19:24:33.998511 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:33.998469    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr" podStartSLOduration=1.998455055 podStartE2EDuration="1.998455055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:33.9963165 +0000 UTC m=+2586.805162936" watchObservedRunningTime="2026-07-09 19:24:33.998455055 +0000 UTC m=+2586.807301489"
Jul 09 19:24:42.976471 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:42.976429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:42.976471 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:42.976472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:42.989255 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:42.989225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:43.035029 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:43.034999    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:24:44.556482 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.556425    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4" podUID="eebd5a76-15f8-46a0-b7bc-b7f5d6299917" containerName="main" containerID="cri-o://d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a" gracePeriod=45
Jul 09 19:24:44.826100 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.826072    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:24:44.931127 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-model-cache\") pod \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") "
Jul 09 19:24:44.931259 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931136    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-home\") pod \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") "
Jul 09 19:24:44.931259 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931206    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-dshm\") pod \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") "
Jul 09 19:24:44.931259 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsw49\" (UniqueName: \"kubernetes.io/projected/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-kube-api-access-zsw49\") pod \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") "
Jul 09 19:24:44.931259 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tls-certs\") pod \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") "
Jul 09 19:24:44.931517 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931270    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tmp-dir\") pod \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\" (UID: \"eebd5a76-15f8-46a0-b7bc-b7f5d6299917\") "
Jul 09 19:24:44.931517 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931374    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-model-cache" (OuterVolumeSpecName: "model-cache") pod "eebd5a76-15f8-46a0-b7bc-b7f5d6299917" (UID: "eebd5a76-15f8-46a0-b7bc-b7f5d6299917"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:44.931517 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-home" (OuterVolumeSpecName: "home") pod "eebd5a76-15f8-46a0-b7bc-b7f5d6299917" (UID: "eebd5a76-15f8-46a0-b7bc-b7f5d6299917"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:44.931671 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931616    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eebd5a76-15f8-46a0-b7bc-b7f5d6299917" (UID: "eebd5a76-15f8-46a0-b7bc-b7f5d6299917"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:44.931734 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931714    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:44.931784 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931739    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:44.931784 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.931754    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:44.933648 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.933616    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-dshm" (OuterVolumeSpecName: "dshm") pod "eebd5a76-15f8-46a0-b7bc-b7f5d6299917" (UID: "eebd5a76-15f8-46a0-b7bc-b7f5d6299917"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:44.933749 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.933671    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-kube-api-access-zsw49" (OuterVolumeSpecName: "kube-api-access-zsw49") pod "eebd5a76-15f8-46a0-b7bc-b7f5d6299917" (UID: "eebd5a76-15f8-46a0-b7bc-b7f5d6299917"). InnerVolumeSpecName "kube-api-access-zsw49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:24:44.933749 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:44.933673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eebd5a76-15f8-46a0-b7bc-b7f5d6299917" (UID: "eebd5a76-15f8-46a0-b7bc-b7f5d6299917"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:24:45.033218 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.033192    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.033312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.033222    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsw49\" (UniqueName: \"kubernetes.io/projected/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-kube-api-access-zsw49\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.033312 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.033237    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd5a76-15f8-46a0-b7bc-b7f5d6299917-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.035500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.035478    2578 generic.go:356] "Generic (PLEG): container finished" podID="eebd5a76-15f8-46a0-b7bc-b7f5d6299917" containerID="d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a" exitCode=0
Jul 09 19:24:45.035589 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.035571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4" event={"ID":"eebd5a76-15f8-46a0-b7bc-b7f5d6299917","Type":"ContainerDied","Data":"d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a"}
Jul 09 19:24:45.035589 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.035574    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"
Jul 09 19:24:45.035662 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.035596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4" event={"ID":"eebd5a76-15f8-46a0-b7bc-b7f5d6299917","Type":"ContainerDied","Data":"1251a22189c5714cc462cf22d46a0fc311bb6fad502fbd8f6197bb7da046eb54"}
Jul 09 19:24:45.035662 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.035613    2578 scope.go:117] "RemoveContainer" containerID="d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a"
Jul 09 19:24:45.044653 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.044638    2578 scope.go:117] "RemoveContainer" containerID="d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a"
Jul 09 19:24:45.044870 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:24:45.044850    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a\": container with ID starting with d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a not found: ID does not exist" containerID="d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a"
Jul 09 19:24:45.044956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.044879    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a"} err="failed to get container status \"d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a\": rpc error: code = NotFound desc = could not find container \"d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a\": container with ID starting with d7de4c0d25d7f306db9261b4941f38e0c55438ce32ad5db04bc447b1b85d496a not found: ID does not exist"
Jul 09 19:24:45.059680 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.059632    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"]
Jul 09 19:24:45.064775 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.064758    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/auth-test-model-18e258-kserve-699488f9f5-4qfj4"]
Jul 09 19:24:45.391390 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.391325    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck" podUID="b2ecca21-3c9f-489a-871b-a3474743dfd9" containerName="main" containerID="cri-o://a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4" gracePeriod=45
Jul 09 19:24:45.640330 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.640301    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eebd5a76-15f8-46a0-b7bc-b7f5d6299917" path="/var/lib/kubelet/pods/eebd5a76-15f8-46a0-b7bc-b7f5d6299917/volumes"
Jul 09 19:24:45.657011 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.656962    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:24:45.739638 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739615    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqmnc\" (UniqueName: \"kubernetes.io/projected/b2ecca21-3c9f-489a-871b-a3474743dfd9-kube-api-access-tqmnc\") pod \"b2ecca21-3c9f-489a-871b-a3474743dfd9\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") "
Jul 09 19:24:45.739751 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-tmp-dir\") pod \"b2ecca21-3c9f-489a-871b-a3474743dfd9\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") "
Jul 09 19:24:45.739751 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-model-cache\") pod \"b2ecca21-3c9f-489a-871b-a3474743dfd9\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") "
Jul 09 19:24:45.739751 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ecca21-3c9f-489a-871b-a3474743dfd9-tls-certs\") pod \"b2ecca21-3c9f-489a-871b-a3474743dfd9\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") "
Jul 09 19:24:45.739872 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-home\") pod \"b2ecca21-3c9f-489a-871b-a3474743dfd9\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") "
Jul 09 19:24:45.739872 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-dshm\") pod \"b2ecca21-3c9f-489a-871b-a3474743dfd9\" (UID: \"b2ecca21-3c9f-489a-871b-a3474743dfd9\") "
Jul 09 19:24:45.740015 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739958    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2ecca21-3c9f-489a-871b-a3474743dfd9" (UID: "b2ecca21-3c9f-489a-871b-a3474743dfd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:45.740095 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.739976    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2ecca21-3c9f-489a-871b-a3474743dfd9" (UID: "b2ecca21-3c9f-489a-871b-a3474743dfd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:45.740095 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.740075    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-home" (OuterVolumeSpecName: "home") pod "b2ecca21-3c9f-489a-871b-a3474743dfd9" (UID: "b2ecca21-3c9f-489a-871b-a3474743dfd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:45.740209 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.740187    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.740209 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.740202    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.740314 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.740218    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.741976 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.741951    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ecca21-3c9f-489a-871b-a3474743dfd9-kube-api-access-tqmnc" (OuterVolumeSpecName: "kube-api-access-tqmnc") pod "b2ecca21-3c9f-489a-871b-a3474743dfd9" (UID: "b2ecca21-3c9f-489a-871b-a3474743dfd9"). InnerVolumeSpecName "kube-api-access-tqmnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:24:45.742235 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.742205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-dshm" (OuterVolumeSpecName: "dshm") pod "b2ecca21-3c9f-489a-871b-a3474743dfd9" (UID: "b2ecca21-3c9f-489a-871b-a3474743dfd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:24:45.742322 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.742278    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2ecca21-3c9f-489a-871b-a3474743dfd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2ecca21-3c9f-489a-871b-a3474743dfd9" (UID: "b2ecca21-3c9f-489a-871b-a3474743dfd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:24:45.841349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.841326    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ecca21-3c9f-489a-871b-a3474743dfd9-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.841349 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.841351    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqmnc\" (UniqueName: \"kubernetes.io/projected/b2ecca21-3c9f-489a-871b-a3474743dfd9-kube-api-access-tqmnc\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:45.841512 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:45.841361    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ecca21-3c9f-489a-871b-a3474743dfd9-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:24:46.043973 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.043946    2578 generic.go:356] "Generic (PLEG): container finished" podID="b2ecca21-3c9f-489a-871b-a3474743dfd9" containerID="a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4" exitCode=0
Jul 09 19:24:46.044131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.043986    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"
Jul 09 19:24:46.044131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.044020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck" event={"ID":"b2ecca21-3c9f-489a-871b-a3474743dfd9","Type":"ContainerDied","Data":"a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4"}
Jul 09 19:24:46.044131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.044072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck" event={"ID":"b2ecca21-3c9f-489a-871b-a3474743dfd9","Type":"ContainerDied","Data":"15cd7b5764da5f60575f850b868eceda1c73df1303bda27c1028419a4e9088cc"}
Jul 09 19:24:46.044131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.044099    2578 scope.go:117] "RemoveContainer" containerID="a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4"
Jul 09 19:24:46.054195 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.054173    2578 scope.go:117] "RemoveContainer" containerID="a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4"
Jul 09 19:24:46.054514 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:24:46.054494    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4\": container with ID starting with a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4 not found: ID does not exist" containerID="a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4"
Jul 09 19:24:46.054586 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.054522    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4"} err="failed to get container status \"a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4\": rpc error: code = NotFound desc = could not find container \"a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4\": container with ID starting with a06e5978afd92cebdfa651b0055312bf1f109a9b79b23cdd251ab8e55e330ad4 not found: ID does not exist"
Jul 09 19:24:46.070391 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.070360    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"]
Jul 09 19:24:46.074704 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:46.074681    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/auth-test-model-2ac82b-kserve-79764ff9ff-6lcck"]
Jul 09 19:24:47.640786 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:47.640751    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ecca21-3c9f-489a-871b-a3474743dfd9" path="/var/lib/kubelet/pods/b2ecca21-3c9f-489a-871b-a3474743dfd9/volumes"
Jul 09 19:24:48.758455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:48.758367    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:24:50.660790 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.660746    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"]
Jul 09 19:24:50.661172 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.661161    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ecca21-3c9f-489a-871b-a3474743dfd9" containerName="main"
Jul 09 19:24:50.661223 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.661174    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ecca21-3c9f-489a-871b-a3474743dfd9" containerName="main"
Jul 09 19:24:50.661223 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.661188    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eebd5a76-15f8-46a0-b7bc-b7f5d6299917" containerName="main"
Jul 09 19:24:50.661223 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.661194    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eebd5a76-15f8-46a0-b7bc-b7f5d6299917" containerName="main"
Jul 09 19:24:50.661320 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.661277    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ecca21-3c9f-489a-871b-a3474743dfd9" containerName="main"
Jul 09 19:24:50.661320 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.661286    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eebd5a76-15f8-46a0-b7bc-b7f5d6299917" containerName="main"
Jul 09 19:24:50.665762 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.665737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.669185 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.669163    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"openshift-service-ca.crt\""
Jul 09 19:24:50.669310 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.669277    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"kube-root-ca.crt\""
Jul 09 19:24:50.670935 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.670914    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"default-dockercfg-lpq9l\""
Jul 09 19:24:50.671065 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.670990    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"sub-test-model-2ac82b-kserve-self-signed-certs\""
Jul 09 19:24:50.675439 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.675408    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"]
Jul 09 19:24:50.699583 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.699559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:50.787630 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.787606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e48f9e-c657-4e09-ae96-3417adb4857d-tls-certs\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.787721 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.787649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-tmp-dir\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.787721 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.787702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-model-cache\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.787791 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.787729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-home\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.787791 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.787752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tg86\" (UniqueName: \"kubernetes.io/projected/49e48f9e-c657-4e09-ae96-3417adb4857d-kube-api-access-2tg86\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.787866 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.787817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-dshm\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.888670 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.888644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-home\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.888770 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.888679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tg86\" (UniqueName: \"kubernetes.io/projected/49e48f9e-c657-4e09-ae96-3417adb4857d-kube-api-access-2tg86\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.888770 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.888700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-dshm\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.888770 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.888729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e48f9e-c657-4e09-ae96-3417adb4857d-tls-certs\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.888900 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.888785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-tmp-dir\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.888981 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.888958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-model-cache\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.889102 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.889080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-home\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.889230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.889203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-tmp-dir\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.889230 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.889219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-model-cache\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.891343 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.891313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-dshm\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.891509 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.891494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e48f9e-c657-4e09-ae96-3417adb4857d-tls-certs\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.901268 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.901236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tg86\" (UniqueName: \"kubernetes.io/projected/49e48f9e-c657-4e09-ae96-3417adb4857d-kube-api-access-2tg86\") pod \"sub-test-model-2ac82b-kserve-bc8596899-whh4m\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") " pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:50.976878 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:50.976853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:24:51.113628 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:51.113601    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"]
Jul 09 19:24:51.114662 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:24:51.114638    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49e48f9e_c657_4e09_ae96_3417adb4857d.slice/crio-83a3c9ed2d38978c5ad8ce6818bb7d9e4b12681fe4264662ff56ffd09ce0c299 WatchSource:0}: Error finding container 83a3c9ed2d38978c5ad8ce6818bb7d9e4b12681fe4264662ff56ffd09ce0c299: Status 404 returned error can't find the container with id 83a3c9ed2d38978c5ad8ce6818bb7d9e4b12681fe4264662ff56ffd09ce0c299
Jul 09 19:24:52.080881 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:52.080845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m" event={"ID":"49e48f9e-c657-4e09-ae96-3417adb4857d","Type":"ContainerStarted","Data":"e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf"}
Jul 09 19:24:52.080881 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:52.080892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m" event={"ID":"49e48f9e-c657-4e09-ae96-3417adb4857d","Type":"ContainerStarted","Data":"83a3c9ed2d38978c5ad8ce6818bb7d9e4b12681fe4264662ff56ffd09ce0c299"}
Jul 09 19:24:52.103021 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:24:52.102979    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m" podStartSLOduration=2.102965634 podStartE2EDuration="2.102965634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:52.102877953 +0000 UTC m=+2604.911724389" watchObservedRunningTime="2026-07-09 19:24:52.102965634 +0000 UTC m=+2604.911812071"
Jul 09 19:25:00.977714 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:00.977674    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:25:00.978149 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:00.977960    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:25:00.990549 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:00.990524    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:25:01.138681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:01.138657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:25:03.849643 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:03.849606    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:25:05.071777 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:05.071749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:05.166216 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:05.166191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:21.864009 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:21.863970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:25:27.674629 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:27.674598    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"]
Jul 09 19:25:27.704477 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:27.704449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:28.469076 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:28.469034    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"]
Jul 09 19:25:28.486619 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:28.486589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:41.044997 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:41.044952    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:25:42.694823 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:42.694774    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr" podUID="beecd774-a40d-4f1d-9455-5cd079b06f49" containerName="main" containerID="cri-o://cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c" gracePeriod=45
Jul 09 19:25:42.950798 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:42.950740    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:25:43.020503 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020474    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5wrb\" (UniqueName: \"kubernetes.io/projected/beecd774-a40d-4f1d-9455-5cd079b06f49-kube-api-access-h5wrb\") pod \"beecd774-a40d-4f1d-9455-5cd079b06f49\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") "
Jul 09 19:25:43.020691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-tmp-dir\") pod \"beecd774-a40d-4f1d-9455-5cd079b06f49\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") "
Jul 09 19:25:43.020691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020567    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beecd774-a40d-4f1d-9455-5cd079b06f49-tls-certs\") pod \"beecd774-a40d-4f1d-9455-5cd079b06f49\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") "
Jul 09 19:25:43.020691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-home\") pod \"beecd774-a40d-4f1d-9455-5cd079b06f49\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") "
Jul 09 19:25:43.020691 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-dshm\") pod \"beecd774-a40d-4f1d-9455-5cd079b06f49\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") "
Jul 09 19:25:43.020898 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020703    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-model-cache\") pod \"beecd774-a40d-4f1d-9455-5cd079b06f49\" (UID: \"beecd774-a40d-4f1d-9455-5cd079b06f49\") "
Jul 09 19:25:43.020898 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020810    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "beecd774-a40d-4f1d-9455-5cd079b06f49" (UID: "beecd774-a40d-4f1d-9455-5cd079b06f49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.020990 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020922    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-home" (OuterVolumeSpecName: "home") pod "beecd774-a40d-4f1d-9455-5cd079b06f49" (UID: "beecd774-a40d-4f1d-9455-5cd079b06f49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.020990 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.020980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-model-cache" (OuterVolumeSpecName: "model-cache") pod "beecd774-a40d-4f1d-9455-5cd079b06f49" (UID: "beecd774-a40d-4f1d-9455-5cd079b06f49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.021100 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.021086    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.021134 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.021102    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.021134 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.021128    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.022795 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.022773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-dshm" (OuterVolumeSpecName: "dshm") pod "beecd774-a40d-4f1d-9455-5cd079b06f49" (UID: "beecd774-a40d-4f1d-9455-5cd079b06f49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.023158 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.023139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beecd774-a40d-4f1d-9455-5cd079b06f49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "beecd774-a40d-4f1d-9455-5cd079b06f49" (UID: "beecd774-a40d-4f1d-9455-5cd079b06f49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:25:43.023225 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.023166    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beecd774-a40d-4f1d-9455-5cd079b06f49-kube-api-access-h5wrb" (OuterVolumeSpecName: "kube-api-access-h5wrb") pod "beecd774-a40d-4f1d-9455-5cd079b06f49" (UID: "beecd774-a40d-4f1d-9455-5cd079b06f49"). InnerVolumeSpecName "kube-api-access-h5wrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:25:43.121814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.121789    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beecd774-a40d-4f1d-9455-5cd079b06f49-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.121814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.121811    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beecd774-a40d-4f1d-9455-5cd079b06f49-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.121945 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.121825    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5wrb\" (UniqueName: \"kubernetes.io/projected/beecd774-a40d-4f1d-9455-5cd079b06f49-kube-api-access-h5wrb\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.364053 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.363971    2578 generic.go:356] "Generic (PLEG): container finished" podID="beecd774-a40d-4f1d-9455-5cd079b06f49" containerID="cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c" exitCode=0
Jul 09 19:25:43.364053 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.364024    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"
Jul 09 19:25:43.364202 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.364086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr" event={"ID":"beecd774-a40d-4f1d-9455-5cd079b06f49","Type":"ContainerDied","Data":"cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c"}
Jul 09 19:25:43.364202 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.364137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr" event={"ID":"beecd774-a40d-4f1d-9455-5cd079b06f49","Type":"ContainerDied","Data":"df080a1d462aa8285104e6c24102519acbcb75f4170d78796cdd2009588313bb"}
Jul 09 19:25:43.364202 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.364157    2578 scope.go:117] "RemoveContainer" containerID="cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c"
Jul 09 19:25:43.375360 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.375340    2578 scope.go:117] "RemoveContainer" containerID="cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c"
Jul 09 19:25:43.375683 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:25:43.375660    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c\": container with ID starting with cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c not found: ID does not exist" containerID="cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c"
Jul 09 19:25:43.375746 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.375694    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c"} err="failed to get container status \"cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c\": rpc error: code = NotFound desc = could not find container \"cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c\": container with ID starting with cc2ff945ef123bc29e2ec5a39f14975315476fbc6fb4b38f6f2269efa10f415c not found: ID does not exist"
Jul 09 19:25:43.391842 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.391810    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"]
Jul 09 19:25:43.396785 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.396759    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/sub-test-model-18e258-kserve-6f5fdf4b65-tkklr"]
Jul 09 19:25:43.494082 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.494040    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m" podUID="49e48f9e-c657-4e09-ae96-3417adb4857d" containerName="main" containerID="cri-o://e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf" gracePeriod=45
Jul 09 19:25:43.640518 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.640445    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beecd774-a40d-4f1d-9455-5cd079b06f49" path="/var/lib/kubelet/pods/beecd774-a40d-4f1d-9455-5cd079b06f49/volumes"
Jul 09 19:25:43.747917 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.747896    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:25:43.828682 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828654    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-dshm\") pod \"49e48f9e-c657-4e09-ae96-3417adb4857d\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") "
Jul 09 19:25:43.828808 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-home\") pod \"49e48f9e-c657-4e09-ae96-3417adb4857d\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") "
Jul 09 19:25:43.828808 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828754    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-tmp-dir\") pod \"49e48f9e-c657-4e09-ae96-3417adb4857d\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") "
Jul 09 19:25:43.828930 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e48f9e-c657-4e09-ae96-3417adb4857d-tls-certs\") pod \"49e48f9e-c657-4e09-ae96-3417adb4857d\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") "
Jul 09 19:25:43.828930 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828840    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tg86\" (UniqueName: \"kubernetes.io/projected/49e48f9e-c657-4e09-ae96-3417adb4857d-kube-api-access-2tg86\") pod \"49e48f9e-c657-4e09-ae96-3417adb4857d\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") "
Jul 09 19:25:43.828930 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-model-cache\") pod \"49e48f9e-c657-4e09-ae96-3417adb4857d\" (UID: \"49e48f9e-c657-4e09-ae96-3417adb4857d\") "
Jul 09 19:25:43.829067 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.828970    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-home" (OuterVolumeSpecName: "home") pod "49e48f9e-c657-4e09-ae96-3417adb4857d" (UID: "49e48f9e-c657-4e09-ae96-3417adb4857d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.829116 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.829069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "49e48f9e-c657-4e09-ae96-3417adb4857d" (UID: "49e48f9e-c657-4e09-ae96-3417adb4857d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.829224 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.829205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-model-cache" (OuterVolumeSpecName: "model-cache") pod "49e48f9e-c657-4e09-ae96-3417adb4857d" (UID: "49e48f9e-c657-4e09-ae96-3417adb4857d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.829302 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.829281    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.829302 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.829303    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.829484 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.829313    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.830962 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.830942    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-dshm" (OuterVolumeSpecName: "dshm") pod "49e48f9e-c657-4e09-ae96-3417adb4857d" (UID: "49e48f9e-c657-4e09-ae96-3417adb4857d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:25:43.831594 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.831571    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e48f9e-c657-4e09-ae96-3417adb4857d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "49e48f9e-c657-4e09-ae96-3417adb4857d" (UID: "49e48f9e-c657-4e09-ae96-3417adb4857d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:25:43.831652 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.831587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e48f9e-c657-4e09-ae96-3417adb4857d-kube-api-access-2tg86" (OuterVolumeSpecName: "kube-api-access-2tg86") pod "49e48f9e-c657-4e09-ae96-3417adb4857d" (UID: "49e48f9e-c657-4e09-ae96-3417adb4857d"). InnerVolumeSpecName "kube-api-access-2tg86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:25:43.930560 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.930532    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49e48f9e-c657-4e09-ae96-3417adb4857d-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.930560 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.930558    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tg86\" (UniqueName: \"kubernetes.io/projected/49e48f9e-c657-4e09-ae96-3417adb4857d-kube-api-access-2tg86\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:43.930692 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:43.930572    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49e48f9e-c657-4e09-ae96-3417adb4857d-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:25:44.370888 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.370809    2578 generic.go:356] "Generic (PLEG): container finished" podID="49e48f9e-c657-4e09-ae96-3417adb4857d" containerID="e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf" exitCode=0
Jul 09 19:25:44.370888 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.370864    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"
Jul 09 19:25:44.371067 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.370905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m" event={"ID":"49e48f9e-c657-4e09-ae96-3417adb4857d","Type":"ContainerDied","Data":"e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf"}
Jul 09 19:25:44.371067 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.370956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m" event={"ID":"49e48f9e-c657-4e09-ae96-3417adb4857d","Type":"ContainerDied","Data":"83a3c9ed2d38978c5ad8ce6818bb7d9e4b12681fe4264662ff56ffd09ce0c299"}
Jul 09 19:25:44.371067 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.370975    2578 scope.go:117] "RemoveContainer" containerID="e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf"
Jul 09 19:25:44.381782 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.381762    2578 scope.go:117] "RemoveContainer" containerID="e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf"
Jul 09 19:25:44.382041 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:25:44.382020    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf\": container with ID starting with e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf not found: ID does not exist" containerID="e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf"
Jul 09 19:25:44.382111 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.382050    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf"} err="failed to get container status \"e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf\": rpc error: code = NotFound desc = could not find container \"e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf\": container with ID starting with e9ae991cc26456372735509a04f619fb121c3d2adebbca2ea4977021d1f3f3bf not found: ID does not exist"
Jul 09 19:25:44.395642 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.395618    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"]
Jul 09 19:25:44.402269 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:44.402248    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/sub-test-model-2ac82b-kserve-bc8596899-whh4m"]
Jul 09 19:25:45.639904 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:45.639858    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49e48f9e-c657-4e09-ae96-3417adb4857d" path="/var/lib/kubelet/pods/49e48f9e-c657-4e09-ae96-3417adb4857d/volumes"
Jul 09 19:25:47.570240 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570209    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"]
Jul 09 19:25:47.570634 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570620    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beecd774-a40d-4f1d-9455-5cd079b06f49" containerName="main"
Jul 09 19:25:47.570634 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570634    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="beecd774-a40d-4f1d-9455-5cd079b06f49" containerName="main"
Jul 09 19:25:47.570713 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570649    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e48f9e-c657-4e09-ae96-3417adb4857d" containerName="main"
Jul 09 19:25:47.570713 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e48f9e-c657-4e09-ae96-3417adb4857d" containerName="main"
Jul 09 19:25:47.570779 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570738    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="beecd774-a40d-4f1d-9455-5cd079b06f49" containerName="main"
Jul 09 19:25:47.570779 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.570749    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e48f9e-c657-4e09-ae96-3417adb4857d" containerName="main"
Jul 09 19:25:47.575029 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.575014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.578623 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.578602    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"kube-root-ca.crt\""
Jul 09 19:25:47.578763 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.578604    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"openshift-service-ca.crt\""
Jul 09 19:25:47.580348 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.580331    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"default-dockercfg-bhkft\""
Jul 09 19:25:47.580650 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.580635    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-18e258\"/\"rate-test-model-18e258-kserve-self-signed-certs\""
Jul 09 19:25:47.586126 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.586106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"]
Jul 09 19:25:47.658288 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.658257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:47.666347 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.666320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-dshm\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.666463 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.666352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tls-certs\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.666463 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.666370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-home\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.666463 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.666399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tmp-dir\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.666463 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.666452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-model-cache\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.666608 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.666484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmzc\" (UniqueName: \"kubernetes.io/projected/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-kube-api-access-6kmzc\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767243 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-dshm\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767344 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tls-certs\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767344 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-home\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767344 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tmp-dir\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767344 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-model-cache\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767599 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmzc\" (UniqueName: \"kubernetes.io/projected/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-kube-api-access-6kmzc\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767714 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-home\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767835 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tmp-dir\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.767896 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.767829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-model-cache\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.769706 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.769686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-dshm\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.769895 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.769880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tls-certs\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.778420 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.778398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmzc\" (UniqueName: \"kubernetes.io/projected/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-kube-api-access-6kmzc\") pod \"rate-test-model-18e258-kserve-86b747f9-wwpt9\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") " pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:47.884374 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:47.884302    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:48.020973 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:48.020944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"]
Jul 09 19:25:48.022412 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:25:48.022368    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91a7e0d6_0d8b_4ce2_af8f_f6364e5e1802.slice/crio-097d13887744b6a833e00a251eaaf2a9e46a0ea0a7ff1d441f3cd48e04ca190d WatchSource:0}: Error finding container 097d13887744b6a833e00a251eaaf2a9e46a0ea0a7ff1d441f3cd48e04ca190d: Status 404 returned error can't find the container with id 097d13887744b6a833e00a251eaaf2a9e46a0ea0a7ff1d441f3cd48e04ca190d
Jul 09 19:25:48.395591 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:48.395557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9" event={"ID":"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802","Type":"ContainerStarted","Data":"6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f"}
Jul 09 19:25:48.395755 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:48.395599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9" event={"ID":"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802","Type":"ContainerStarted","Data":"097d13887744b6a833e00a251eaaf2a9e46a0ea0a7ff1d441f3cd48e04ca190d"}
Jul 09 19:25:48.416994 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:48.416951    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9" podStartSLOduration=1.41693673 podStartE2EDuration="1.41693673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:25:48.416156203 +0000 UTC m=+2661.225002642" watchObservedRunningTime="2026-07-09 19:25:48.41693673 +0000 UTC m=+2661.225783166"
Jul 09 19:25:53.957191 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:53.957154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:25:57.884501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:57.884459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:57.884930 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:57.884540    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:57.897205 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:57.897178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:25:58.460167 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:25:58.460137    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:26:13.253084 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.253050    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"]
Jul 09 19:26:13.256648 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.256630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.261892 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.261866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"rate-test-model-2ac82b-kserve-self-signed-certs\""
Jul 09 19:26:13.262070 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.261898    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"kube-root-ca.crt\""
Jul 09 19:26:13.262202 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.262143    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"default-dockercfg-lpq9l\""
Jul 09 19:26:13.262270 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.262223    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2ac82b\"/\"openshift-service-ca.crt\""
Jul 09 19:26:13.267739 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.267717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"]
Jul 09 19:26:13.285708 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.285674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:13.379841 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.379813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-home\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.379956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.379868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tmp-dir\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.379956 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.379930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz5z6\" (UniqueName: \"kubernetes.io/projected/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-kube-api-access-nz5z6\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.380054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.379972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-model-cache\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.380054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.380007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-dshm\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.380054 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.380036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tls-certs\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481011 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.480979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-home\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481147 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tmp-dir\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481147 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz5z6\" (UniqueName: \"kubernetes.io/projected/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-kube-api-access-nz5z6\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481147 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-model-cache\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481147 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-dshm\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481408 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tls-certs\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tmp-dir\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-home\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.481607 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.481591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-model-cache\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.483415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.483372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-dshm\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.483737 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.483721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tls-certs\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.491667 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.491645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz5z6\" (UniqueName: \"kubernetes.io/projected/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-kube-api-access-nz5z6\") pod \"rate-test-model-2ac82b-kserve-797c44b899-8snfp\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") " pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.568507 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.568453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:13.708522 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:13.708498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"]
Jul 09 19:26:13.710597 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:26:13.710570    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacd0f329_d8d2_40d4_9ba2_503cd10e8ca1.slice/crio-564c883d6b8407131a3f70adf84ac3adacd49f914b1cd3eca3e03715aec7d552 WatchSource:0}: Error finding container 564c883d6b8407131a3f70adf84ac3adacd49f914b1cd3eca3e03715aec7d552: Status 404 returned error can't find the container with id 564c883d6b8407131a3f70adf84ac3adacd49f914b1cd3eca3e03715aec7d552
Jul 09 19:26:14.538024 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:14.537982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp" event={"ID":"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1","Type":"ContainerStarted","Data":"0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184"}
Jul 09 19:26:14.538433 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:14.538036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp" event={"ID":"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1","Type":"ContainerStarted","Data":"564c883d6b8407131a3f70adf84ac3adacd49f914b1cd3eca3e03715aec7d552"}
Jul 09 19:26:14.558189 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:14.558147    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp" podStartSLOduration=1.5581319649999998 podStartE2EDuration="1.558131965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:26:14.557261653 +0000 UTC m=+2687.366108087" watchObservedRunningTime="2026-07-09 19:26:14.558131965 +0000 UTC m=+2687.366978399"
Jul 09 19:26:17.959192 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:17.959157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:26:23.569723 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:23.569692    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:23.570105 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:23.569739    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:23.582322 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:23.582297    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:23.594357 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:23.594332    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:26:27.792532 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:27.792500    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:26:27.800183 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:27.800158    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:26:27.802969 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:27.802947    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:26:27.809935 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:27.809918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s685n_48d4d772-ffbd-4222-bf8d-537649eb0379/ovn-acl-logging/0.log"
Jul 09 19:26:33.055471 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:33.055438    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:26:48.851399 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:48.851348    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:26:56.996350 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:56.996322    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"]
Jul 09 19:26:57.021909 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:57.021877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:57.942437 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:57.942394    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"]
Jul 09 19:26:57.965450 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:26:57.965423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:03.758424 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:03.758388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:27:08.491427 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:08.491364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:08.595084 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:08.595056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:12.017052 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.017016    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9" podUID="91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" containerName="main" containerID="cri-o://6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f" gracePeriod=45
Jul 09 19:27:12.265333 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.265308    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:27:12.393194 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-dshm\") pod \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") "
Jul 09 19:27:12.393194 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393167    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tls-certs\") pod \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") "
Jul 09 19:27:12.393415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tmp-dir\") pod \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") "
Jul 09 19:27:12.393415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-model-cache\") pod \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") "
Jul 09 19:27:12.393415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393259    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kmzc\" (UniqueName: \"kubernetes.io/projected/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-kube-api-access-6kmzc\") pod \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") "
Jul 09 19:27:12.393415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-home\") pod \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\" (UID: \"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802\") "
Jul 09 19:27:12.393638 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" (UID: "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:12.393638 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393612    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-home" (OuterVolumeSpecName: "home") pod "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" (UID: "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:12.393638 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.393623    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-model-cache" (OuterVolumeSpecName: "model-cache") pod "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" (UID: "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:12.395436 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.395415    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-dshm" (OuterVolumeSpecName: "dshm") pod "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" (UID: "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:12.395589 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.395565    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" (UID: "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:12.395636 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.395582    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-kube-api-access-6kmzc" (OuterVolumeSpecName: "kube-api-access-6kmzc") pod "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" (UID: "91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802"). InnerVolumeSpecName "kube-api-access-6kmzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:12.494080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.494057    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:12.494080 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.494078    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:12.494201 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.494088    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:12.494201 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.494096    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:12.494201 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.494104    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kmzc\" (UniqueName: \"kubernetes.io/projected/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-kube-api-access-6kmzc\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:12.494201 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.494112    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:12.839919 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.839889    2578 generic.go:356] "Generic (PLEG): container finished" podID="91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" containerID="6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f" exitCode=0
Jul 09 19:27:12.840063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.839941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"
Jul 09 19:27:12.840063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.839971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9" event={"ID":"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802","Type":"ContainerDied","Data":"6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f"}
Jul 09 19:27:12.840063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.840015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9" event={"ID":"91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802","Type":"ContainerDied","Data":"097d13887744b6a833e00a251eaaf2a9e46a0ea0a7ff1d441f3cd48e04ca190d"}
Jul 09 19:27:12.840063 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.840034    2578 scope.go:117] "RemoveContainer" containerID="6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f"
Jul 09 19:27:12.848802 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.848786    2578 scope.go:117] "RemoveContainer" containerID="6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f"
Jul 09 19:27:12.849061 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:27:12.849045    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f\": container with ID starting with 6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f not found: ID does not exist" containerID="6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f"
Jul 09 19:27:12.849112 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.849070    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f"} err="failed to get container status \"6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f\": rpc error: code = NotFound desc = could not find container \"6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f\": container with ID starting with 6609015b2b22f5155eb04e5142b3b5c981369c410fb1e348f292572e33140b4f not found: ID does not exist"
Jul 09 19:27:12.865903 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.865875    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"]
Jul 09 19:27:12.874289 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.874268    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-18e258/rate-test-model-18e258-kserve-86b747f9-wwpt9"]
Jul 09 19:27:12.962763 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:12.962718    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp" podUID="acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" containerName="main" containerID="cri-o://0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184" gracePeriod=45
Jul 09 19:27:13.211337 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.211308    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:27:13.301899 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.301873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-home\") pod \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") "
Jul 09 19:27:13.302023 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.301977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz5z6\" (UniqueName: \"kubernetes.io/projected/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-kube-api-access-nz5z6\") pod \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") "
Jul 09 19:27:13.302023 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302008    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-model-cache\") pod \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") "
Jul 09 19:27:13.302131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302025    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tmp-dir\") pod \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") "
Jul 09 19:27:13.302131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302053    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tls-certs\") pod \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") "
Jul 09 19:27:13.302131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302076    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-dshm\") pod \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\" (UID: \"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1\") "
Jul 09 19:27:13.302276 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302124    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-home" (OuterVolumeSpecName: "home") pod "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" (UID: "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:13.302336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302306    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-model-cache" (OuterVolumeSpecName: "model-cache") pod "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" (UID: "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:13.302336 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" (UID: "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:13.302457 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.302370    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-home\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.304242 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.304224    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-dshm" (OuterVolumeSpecName: "dshm") pod "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" (UID: "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:13.304242 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.304230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-kube-api-access-nz5z6" (OuterVolumeSpecName: "kube-api-access-nz5z6") pod "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" (UID: "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1"). InnerVolumeSpecName "kube-api-access-nz5z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:13.304339 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.304292    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" (UID: "acd0f329-d8d2-40d4-9ba2-503cd10e8ca1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:13.402792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.402728    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz5z6\" (UniqueName: \"kubernetes.io/projected/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-kube-api-access-nz5z6\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.402792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.402754    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-model-cache\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.402792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.402767    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tmp-dir\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.402792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.402777    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-tls-certs\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.402792 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.402788    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1-dshm\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:13.641033 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.641006    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" path="/var/lib/kubelet/pods/91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802/volumes"
Jul 09 19:27:13.847125 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.847097    2578 generic.go:356] "Generic (PLEG): container finished" podID="acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" containerID="0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184" exitCode=0
Jul 09 19:27:13.847251 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.847136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp" event={"ID":"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1","Type":"ContainerDied","Data":"0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184"}
Jul 09 19:27:13.847251 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.847145    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"
Jul 09 19:27:13.847251 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.847182    2578 scope.go:117] "RemoveContainer" containerID="0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184"
Jul 09 19:27:13.847416 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.847170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp" event={"ID":"acd0f329-d8d2-40d4-9ba2-503cd10e8ca1","Type":"ContainerDied","Data":"564c883d6b8407131a3f70adf84ac3adacd49f914b1cd3eca3e03715aec7d552"}
Jul 09 19:27:13.855893 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.855871    2578 scope.go:117] "RemoveContainer" containerID="0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184"
Jul 09 19:27:13.856171 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:27:13.856150    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184\": container with ID starting with 0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184 not found: ID does not exist" containerID="0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184"
Jul 09 19:27:13.856222 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.856178    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184"} err="failed to get container status \"0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184\": rpc error: code = NotFound desc = could not find container \"0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184\": container with ID starting with 0ced708479f21da888b27120c6f6dca6724a3ec510c76f0fa09a252e16a5c184 not found: ID does not exist"
Jul 09 19:27:13.869154 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.869132    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"]
Jul 09 19:27:13.873476 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:13.873456    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2ac82b/rate-test-model-2ac82b-kserve-797c44b899-8snfp"]
Jul 09 19:27:15.640217 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:15.640179    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" path="/var/lib/kubelet/pods/acd0f329-d8d2-40d4-9ba2-503cd10e8ca1/volumes"
Jul 09 19:27:16.560318 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:16.560287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:16.659841 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:16.659815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:19.948791 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:19.948757    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:27:20.549798 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.549755    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7577-139661738362416"]
Jul 09 19:27:20.550237 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.550220    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" containerName="main"
Jul 09 19:27:20.550292 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.550240    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" containerName="main"
Jul 09 19:27:20.550292 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.550254    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" containerName="main"
Jul 09 19:27:20.550292 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.550260    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" containerName="main"
Jul 09 19:27:20.550417 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.550365    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd0f329-d8d2-40d4-9ba2-503cd10e8ca1" containerName="main"
Jul 09 19:27:20.550417 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.550396    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a7e0d6-0d8b-4ce2-af8f-f6364e5e1802" containerName="main"
Jul 09 19:27:20.555083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.555062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:20.558641 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.558612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-csz5m\""
Jul 09 19:27:20.559469 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.559440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661738362416"]
Jul 09 19:27:20.661547 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.661517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsjbx\" (UniqueName: \"kubernetes.io/projected/2d68f280-cfb0-4810-be52-d5474d5587f1-kube-api-access-xsjbx\") pod \"test-curl-7577-139661738362416\" (UID: \"2d68f280-cfb0-4810-be52-d5474d5587f1\") " pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:20.762296 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.762266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsjbx\" (UniqueName: \"kubernetes.io/projected/2d68f280-cfb0-4810-be52-d5474d5587f1-kube-api-access-xsjbx\") pod \"test-curl-7577-139661738362416\" (UID: \"2d68f280-cfb0-4810-be52-d5474d5587f1\") " pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:20.773659 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.773631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsjbx\" (UniqueName: \"kubernetes.io/projected/2d68f280-cfb0-4810-be52-d5474d5587f1-kube-api-access-xsjbx\") pod \"test-curl-7577-139661738362416\" (UID: \"2d68f280-cfb0-4810-be52-d5474d5587f1\") " pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:20.866964 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:20.866904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:21.003100 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:21.003071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661738362416"]
Jul 09 19:27:21.004577 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:27:21.004545    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d68f280_cfb0_4810_be52_d5474d5587f1.slice/crio-3fa6c2523583cc80bf893deea1b8daf02c327eb718b7394bb9ec4a1c95588c17 WatchSource:0}: Error finding container 3fa6c2523583cc80bf893deea1b8daf02c327eb718b7394bb9ec4a1c95588c17: Status 404 returned error can't find the container with id 3fa6c2523583cc80bf893deea1b8daf02c327eb718b7394bb9ec4a1c95588c17
Jul 09 19:27:21.005882 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:21.005867    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:27:21.895196 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:21.895164    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d68f280-cfb0-4810-be52-d5474d5587f1" containerID="4997a00e1b9c02a4fc849979395f03e9528ab9f33bcfa2ae368b865b33e8981a" exitCode=0
Jul 09 19:27:21.895305 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:21.895252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661738362416" event={"ID":"2d68f280-cfb0-4810-be52-d5474d5587f1","Type":"ContainerDied","Data":"4997a00e1b9c02a4fc849979395f03e9528ab9f33bcfa2ae368b865b33e8981a"}
Jul 09 19:27:21.895305 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:21.895293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661738362416" event={"ID":"2d68f280-cfb0-4810-be52-d5474d5587f1","Type":"ContainerStarted","Data":"3fa6c2523583cc80bf893deea1b8daf02c327eb718b7394bb9ec4a1c95588c17"}
Jul 09 19:27:23.032321 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.032301    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:23.059817 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.059795    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7577-139661738362416_2d68f280-cfb0-4810-be52-d5474d5587f1/test-curl-7577-139661738362416/0.log"
Jul 09 19:27:23.084555 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.084532    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsjbx\" (UniqueName: \"kubernetes.io/projected/2d68f280-cfb0-4810-be52-d5474d5587f1-kube-api-access-xsjbx\") pod \"2d68f280-cfb0-4810-be52-d5474d5587f1\" (UID: \"2d68f280-cfb0-4810-be52-d5474d5587f1\") "
Jul 09 19:27:23.086563 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.086536    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d68f280-cfb0-4810-be52-d5474d5587f1-kube-api-access-xsjbx" (OuterVolumeSpecName: "kube-api-access-xsjbx") pod "2d68f280-cfb0-4810-be52-d5474d5587f1" (UID: "2d68f280-cfb0-4810-be52-d5474d5587f1"). InnerVolumeSpecName "kube-api-access-xsjbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:23.098494 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.098473    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7577-139661738362416"]
Jul 09 19:27:23.102045 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.102025    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7577-139661738362416"]
Jul 09 19:27:23.185530 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.185508    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsjbx\" (UniqueName: \"kubernetes.io/projected/2d68f280-cfb0-4810-be52-d5474d5587f1-kube-api-access-xsjbx\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:23.232697 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.232673    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7577-139661738363824"]
Jul 09 19:27:23.233083 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.233070    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d68f280-cfb0-4810-be52-d5474d5587f1" containerName="test-curl-7577-139661738362416"
Jul 09 19:27:23.233124 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.233085    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d68f280-cfb0-4810-be52-d5474d5587f1" containerName="test-curl-7577-139661738362416"
Jul 09 19:27:23.233164 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.233148    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d68f280-cfb0-4810-be52-d5474d5587f1" containerName="test-curl-7577-139661738362416"
Jul 09 19:27:23.236203 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.236188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:23.243891 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.243867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661738363824"]
Jul 09 19:27:23.285864 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.285830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sd2m\" (UniqueName: \"kubernetes.io/projected/d57a30cd-5078-4dde-9b1d-37513700c739-kube-api-access-2sd2m\") pod \"test-curl-7577-139661738363824\" (UID: \"d57a30cd-5078-4dde-9b1d-37513700c739\") " pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:23.387108 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.387080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sd2m\" (UniqueName: \"kubernetes.io/projected/d57a30cd-5078-4dde-9b1d-37513700c739-kube-api-access-2sd2m\") pod \"test-curl-7577-139661738363824\" (UID: \"d57a30cd-5078-4dde-9b1d-37513700c739\") " pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:23.397852 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.397828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sd2m\" (UniqueName: \"kubernetes.io/projected/d57a30cd-5078-4dde-9b1d-37513700c739-kube-api-access-2sd2m\") pod \"test-curl-7577-139661738363824\" (UID: \"d57a30cd-5078-4dde-9b1d-37513700c739\") " pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:23.545840 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.545776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:23.642551 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.642520    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d68f280-cfb0-4810-be52-d5474d5587f1" path="/var/lib/kubelet/pods/2d68f280-cfb0-4810-be52-d5474d5587f1/volumes"
Jul 09 19:27:23.681547 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.681525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661738363824"]
Jul 09 19:27:23.682933 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:27:23.682905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd57a30cd_5078_4dde_9b1d_37513700c739.slice/crio-c3491225083997bc1c32761eaee7c9125a465d17a4d87a85886872b62bc8ca0a WatchSource:0}: Error finding container c3491225083997bc1c32761eaee7c9125a465d17a4d87a85886872b62bc8ca0a: Status 404 returned error can't find the container with id c3491225083997bc1c32761eaee7c9125a465d17a4d87a85886872b62bc8ca0a
Jul 09 19:27:23.906571 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.906511    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738362416"
Jul 09 19:27:23.906571 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.906547    2578 scope.go:117] "RemoveContainer" containerID="4997a00e1b9c02a4fc849979395f03e9528ab9f33bcfa2ae368b865b33e8981a"
Jul 09 19:27:23.907961 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:23.907932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661738363824" event={"ID":"d57a30cd-5078-4dde-9b1d-37513700c739","Type":"ContainerStarted","Data":"c3491225083997bc1c32761eaee7c9125a465d17a4d87a85886872b62bc8ca0a"}
Jul 09 19:27:24.915818 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:24.915781    2578 generic.go:356] "Generic (PLEG): container finished" podID="d57a30cd-5078-4dde-9b1d-37513700c739" containerID="c711aef96740fd6a4ae7939e6652756755a73d63e1b71fd1e82bc1ae89862cd5" exitCode=0
Jul 09 19:27:24.916261 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:24.915864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661738363824" event={"ID":"d57a30cd-5078-4dde-9b1d-37513700c739","Type":"ContainerDied","Data":"c711aef96740fd6a4ae7939e6652756755a73d63e1b71fd1e82bc1ae89862cd5"}
Jul 09 19:27:26.075979 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.075957    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:26.100017 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.099994    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7577-139661738363824_d57a30cd-5078-4dde-9b1d-37513700c739/test-curl-7577-139661738363824/0.log"
Jul 09 19:27:26.111175 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.111155    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sd2m\" (UniqueName: \"kubernetes.io/projected/d57a30cd-5078-4dde-9b1d-37513700c739-kube-api-access-2sd2m\") pod \"d57a30cd-5078-4dde-9b1d-37513700c739\" (UID: \"d57a30cd-5078-4dde-9b1d-37513700c739\") "
Jul 09 19:27:26.113280 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.113256    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57a30cd-5078-4dde-9b1d-37513700c739-kube-api-access-2sd2m" (OuterVolumeSpecName: "kube-api-access-2sd2m") pod "d57a30cd-5078-4dde-9b1d-37513700c739" (UID: "d57a30cd-5078-4dde-9b1d-37513700c739"). InnerVolumeSpecName "kube-api-access-2sd2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:26.127913 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.127890    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7577-139661738363824"]
Jul 09 19:27:26.132697 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.132678    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7577-139661738363824"]
Jul 09 19:27:26.212128 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.212066    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sd2m\" (UniqueName: \"kubernetes.io/projected/d57a30cd-5078-4dde-9b1d-37513700c739-kube-api-access-2sd2m\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:26.298367 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.298339    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:26.298781 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.298766    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57a30cd-5078-4dde-9b1d-37513700c739" containerName="test-curl-7577-139661738363824"
Jul 09 19:27:26.298821 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.298784    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57a30cd-5078-4dde-9b1d-37513700c739" containerName="test-curl-7577-139661738363824"
Jul 09 19:27:26.298870 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.298861    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57a30cd-5078-4dde-9b1d-37513700c739" containerName="test-curl-7577-139661738363824"
Jul 09 19:27:26.301896 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.301880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:26.306090 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.306063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:26.313527 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.313501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqwfp\" (UniqueName: \"kubernetes.io/projected/0aa46e23-0c1d-4591-b39a-3d78b93657b6-kube-api-access-fqwfp\") pod \"test-curl-7577-139661739261792\" (UID: \"0aa46e23-0c1d-4591-b39a-3d78b93657b6\") " pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:26.414868 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.414844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqwfp\" (UniqueName: \"kubernetes.io/projected/0aa46e23-0c1d-4591-b39a-3d78b93657b6-kube-api-access-fqwfp\") pod \"test-curl-7577-139661739261792\" (UID: \"0aa46e23-0c1d-4591-b39a-3d78b93657b6\") " pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:26.425194 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.425173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqwfp\" (UniqueName: \"kubernetes.io/projected/0aa46e23-0c1d-4591-b39a-3d78b93657b6-kube-api-access-fqwfp\") pod \"test-curl-7577-139661739261792\" (UID: \"0aa46e23-0c1d-4591-b39a-3d78b93657b6\") " pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:26.611514 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.611461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:26.752044 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.752011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:26.752636 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:27:26.752610    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aa46e23_0c1d_4591_b39a_3d78b93657b6.slice/crio-4e6d84df21796050700f3d35524414b7c1bd3264f16a89306f7f9d3fabd2a308 WatchSource:0}: Error finding container 4e6d84df21796050700f3d35524414b7c1bd3264f16a89306f7f9d3fabd2a308: Status 404 returned error can't find the container with id 4e6d84df21796050700f3d35524414b7c1bd3264f16a89306f7f9d3fabd2a308
Jul 09 19:27:26.926363 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.926334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739261792" event={"ID":"0aa46e23-0c1d-4591-b39a-3d78b93657b6","Type":"ContainerStarted","Data":"4e6d84df21796050700f3d35524414b7c1bd3264f16a89306f7f9d3fabd2a308"}
Jul 09 19:27:26.927532 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.927513    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:26.927625 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:26.927540    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3491225083997bc1c32761eaee7c9125a465d17a4d87a85886872b62bc8ca0a"
Jul 09 19:27:26.940932 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:27:26.940906    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7577-139661738363824\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="d57a30cd-5078-4dde-9b1d-37513700c739" pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:27.639187 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:27:27.639154    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7577-139661738363824\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="d57a30cd-5078-4dde-9b1d-37513700c739" pod="openshift-ingress/test-curl-7577-139661738363824"
Jul 09 19:27:27.639912 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:27.639880    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57a30cd-5078-4dde-9b1d-37513700c739" path="/var/lib/kubelet/pods/d57a30cd-5078-4dde-9b1d-37513700c739/volumes"
Jul 09 19:27:27.934231 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:27.934201    2578 generic.go:356] "Generic (PLEG): container finished" podID="0aa46e23-0c1d-4591-b39a-3d78b93657b6" containerID="ca38a138dbea831a24a5e6ed5375bad37ef0674a2d2e8fbdbc8bb1a2b816eb0c" exitCode=0
Jul 09 19:27:27.934328 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:27.934281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739261792" event={"ID":"0aa46e23-0c1d-4591-b39a-3d78b93657b6","Type":"ContainerDied","Data":"ca38a138dbea831a24a5e6ed5375bad37ef0674a2d2e8fbdbc8bb1a2b816eb0c"}
Jul 09 19:27:29.101265 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.101242    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.124092 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.124062    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7577-139661739261792_0aa46e23-0c1d-4591-b39a-3d78b93657b6/test-curl-7577-139661739261792/0.log"
Jul 09 19:27:29.138422 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.138403    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqwfp\" (UniqueName: \"kubernetes.io/projected/0aa46e23-0c1d-4591-b39a-3d78b93657b6-kube-api-access-fqwfp\") pod \"0aa46e23-0c1d-4591-b39a-3d78b93657b6\" (UID: \"0aa46e23-0c1d-4591-b39a-3d78b93657b6\") "
Jul 09 19:27:29.140533 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.140505    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa46e23-0c1d-4591-b39a-3d78b93657b6-kube-api-access-fqwfp" (OuterVolumeSpecName: "kube-api-access-fqwfp") pod "0aa46e23-0c1d-4591-b39a-3d78b93657b6" (UID: "0aa46e23-0c1d-4591-b39a-3d78b93657b6"). InnerVolumeSpecName "kube-api-access-fqwfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:29.151631 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.151606    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:29.156151 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.156131    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:29.239615 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.239561    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqwfp\" (UniqueName: \"kubernetes.io/projected/0aa46e23-0c1d-4591-b39a-3d78b93657b6-kube-api-access-fqwfp\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:29.284090 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.284053    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:29.284501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.284487    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa46e23-0c1d-4591-b39a-3d78b93657b6" containerName="test-curl-7577-139661739261792"
Jul 09 19:27:29.284553 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.284503    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa46e23-0c1d-4591-b39a-3d78b93657b6" containerName="test-curl-7577-139661739261792"
Jul 09 19:27:29.284597 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.284587    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa46e23-0c1d-4591-b39a-3d78b93657b6" containerName="test-curl-7577-139661739261792"
Jul 09 19:27:29.287602 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.287588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.291922 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.291902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:29.340934 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.340909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw4jl\" (UniqueName: \"kubernetes.io/projected/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b-kube-api-access-jw4jl\") pod \"test-curl-7577-139661739261792\" (UID: \"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b\") " pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.441950 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.441921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw4jl\" (UniqueName: \"kubernetes.io/projected/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b-kube-api-access-jw4jl\") pod \"test-curl-7577-139661739261792\" (UID: \"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b\") " pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.452417 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.452373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw4jl\" (UniqueName: \"kubernetes.io/projected/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b-kube-api-access-jw4jl\") pod \"test-curl-7577-139661739261792\" (UID: \"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b\") " pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.598943 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.598873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.642144 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.642109    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa46e23-0c1d-4591-b39a-3d78b93657b6" path="/var/lib/kubelet/pods/0aa46e23-0c1d-4591-b39a-3d78b93657b6/volumes"
Jul 09 19:27:29.736836 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.736812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:29.738466 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:27:29.738432    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5d9fc3d_16b0_43ae_9c5b_2a5f57df852b.slice/crio-85631a2ffa6af69f76e25743836a96c2b9b7ebbe442cc6d14be8ffe8647eccbe WatchSource:0}: Error finding container 85631a2ffa6af69f76e25743836a96c2b9b7ebbe442cc6d14be8ffe8647eccbe: Status 404 returned error can't find the container with id 85631a2ffa6af69f76e25743836a96c2b9b7ebbe442cc6d14be8ffe8647eccbe
Jul 09 19:27:29.946503 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.946479    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:29.946616 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.946530    2578 scope.go:117] "RemoveContainer" containerID="ca38a138dbea831a24a5e6ed5375bad37ef0674a2d2e8fbdbc8bb1a2b816eb0c"
Jul 09 19:27:29.947872 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:29.947844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739261792" event={"ID":"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b","Type":"ContainerStarted","Data":"85631a2ffa6af69f76e25743836a96c2b9b7ebbe442cc6d14be8ffe8647eccbe"}
Jul 09 19:27:30.953862 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:30.953823    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" containerID="4c9db7d068a4227f42818e01093cccb58f3ad391820b71464aca640a05ff241e" exitCode=0
Jul 09 19:27:30.954288 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:30.953906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739261792" event={"ID":"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b","Type":"ContainerDied","Data":"4c9db7d068a4227f42818e01093cccb58f3ad391820b71464aca640a05ff241e"}
Jul 09 19:27:32.099208 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.099188    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:32.122373 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.122345    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7577-139661739261792_a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b/test-curl-7577-139661739261792/0.log"
Jul 09 19:27:32.151015 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.150990    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:32.157627 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.157604    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7577-139661739261792"]
Jul 09 19:27:32.162455 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.162435    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw4jl\" (UniqueName: \"kubernetes.io/projected/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b-kube-api-access-jw4jl\") pod \"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b\" (UID: \"a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b\") "
Jul 09 19:27:32.164529 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.164509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b-kube-api-access-jw4jl" (OuterVolumeSpecName: "kube-api-access-jw4jl") pod "a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" (UID: "a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b"). InnerVolumeSpecName "kube-api-access-jw4jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:32.263846 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.263793    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw4jl\" (UniqueName: \"kubernetes.io/projected/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b-kube-api-access-jw4jl\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:32.285998 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.285969    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:32.286415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.286370    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" containerName="test-curl-7577-139661739261792"
Jul 09 19:27:32.286415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.286406    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" containerName="test-curl-7577-139661739261792"
Jul 09 19:27:32.286558 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.286548    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" containerName="test-curl-7577-139661739261792"
Jul 09 19:27:32.289492 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.289475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:32.294813 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.294792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:32.364204 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.364176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ds2\" (UniqueName: \"kubernetes.io/projected/51ff29af-4e37-402e-ba75-0dc96446d463-kube-api-access-t7ds2\") pod \"test-curl-7577-139661739260640\" (UID: \"51ff29af-4e37-402e-ba75-0dc96446d463\") " pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:32.465504 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.465477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ds2\" (UniqueName: \"kubernetes.io/projected/51ff29af-4e37-402e-ba75-0dc96446d463-kube-api-access-t7ds2\") pod \"test-curl-7577-139661739260640\" (UID: \"51ff29af-4e37-402e-ba75-0dc96446d463\") " pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:32.475717 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.475694    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ds2\" (UniqueName: \"kubernetes.io/projected/51ff29af-4e37-402e-ba75-0dc96446d463-kube-api-access-t7ds2\") pod \"test-curl-7577-139661739260640\" (UID: \"51ff29af-4e37-402e-ba75-0dc96446d463\") " pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:32.599513 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.599459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:32.737663 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.737638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:32.740016 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:27:32.739984    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51ff29af_4e37_402e_ba75_0dc96446d463.slice/crio-fca547e68526696d4e7e65d6442c06c975e611b229fbb9cf411ec5d1413479a6 WatchSource:0}: Error finding container fca547e68526696d4e7e65d6442c06c975e611b229fbb9cf411ec5d1413479a6: Status 404 returned error can't find the container with id fca547e68526696d4e7e65d6442c06c975e611b229fbb9cf411ec5d1413479a6
Jul 09 19:27:32.967187 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.967158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739260640" event={"ID":"51ff29af-4e37-402e-ba75-0dc96446d463","Type":"ContainerStarted","Data":"fca547e68526696d4e7e65d6442c06c975e611b229fbb9cf411ec5d1413479a6"}
Jul 09 19:27:32.968365 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.968345    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:32.968365 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:32.968357    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85631a2ffa6af69f76e25743836a96c2b9b7ebbe442cc6d14be8ffe8647eccbe"
Jul 09 19:27:32.979340 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:27:32.979315    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7577-139661739261792\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" pod="openshift-ingress/test-curl-7577-139661739261792"
Jul 09 19:27:33.640061 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:33.640031    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b" path="/var/lib/kubelet/pods/a5d9fc3d-16b0-43ae-9c5b-2a5f57df852b/volumes"
Jul 09 19:27:33.975500 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:33.975470    2578 generic.go:356] "Generic (PLEG): container finished" podID="51ff29af-4e37-402e-ba75-0dc96446d463" containerID="2926366cbae2bd38930cc6fa6be2c4497484a2a03002c9c68524651b5f4d15fb" exitCode=0
Jul 09 19:27:33.975646 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:33.975563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739260640" event={"ID":"51ff29af-4e37-402e-ba75-0dc96446d463","Type":"ContainerDied","Data":"2926366cbae2bd38930cc6fa6be2c4497484a2a03002c9c68524651b5f4d15fb"}
Jul 09 19:27:35.128665 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.128638    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.153531 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.153506    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7577-139661739260640_51ff29af-4e37-402e-ba75-0dc96446d463/test-curl-7577-139661739260640/0.log"
Jul 09 19:27:35.181921 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.181896    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:35.187608 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.187587    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:35.191900 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.191883    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7ds2\" (UniqueName: \"kubernetes.io/projected/51ff29af-4e37-402e-ba75-0dc96446d463-kube-api-access-t7ds2\") pod \"51ff29af-4e37-402e-ba75-0dc96446d463\" (UID: \"51ff29af-4e37-402e-ba75-0dc96446d463\") "
Jul 09 19:27:35.193957 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.193938    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ff29af-4e37-402e-ba75-0dc96446d463-kube-api-access-t7ds2" (OuterVolumeSpecName: "kube-api-access-t7ds2") pod "51ff29af-4e37-402e-ba75-0dc96446d463" (UID: "51ff29af-4e37-402e-ba75-0dc96446d463"). InnerVolumeSpecName "kube-api-access-t7ds2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:35.293569 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.293518    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7ds2\" (UniqueName: \"kubernetes.io/projected/51ff29af-4e37-402e-ba75-0dc96446d463-kube-api-access-t7ds2\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:35.318502 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.318474    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:35.318862 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.318849    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ff29af-4e37-402e-ba75-0dc96446d463" containerName="test-curl-7577-139661739260640"
Jul 09 19:27:35.318912 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.318864    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ff29af-4e37-402e-ba75-0dc96446d463" containerName="test-curl-7577-139661739260640"
Jul 09 19:27:35.318953 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.318946    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ff29af-4e37-402e-ba75-0dc96446d463" containerName="test-curl-7577-139661739260640"
Jul 09 19:27:35.321895 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.321877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.328862 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.328766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:35.394860 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.394838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5w8f\" (UniqueName: \"kubernetes.io/projected/b63c3675-421f-4953-b86f-6355dce2df2f-kube-api-access-n5w8f\") pod \"test-curl-7577-139661739260640\" (UID: \"b63c3675-421f-4953-b86f-6355dce2df2f\") " pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.495580 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.495560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5w8f\" (UniqueName: \"kubernetes.io/projected/b63c3675-421f-4953-b86f-6355dce2df2f-kube-api-access-n5w8f\") pod \"test-curl-7577-139661739260640\" (UID: \"b63c3675-421f-4953-b86f-6355dce2df2f\") " pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.505325 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.505296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5w8f\" (UniqueName: \"kubernetes.io/projected/b63c3675-421f-4953-b86f-6355dce2df2f-kube-api-access-n5w8f\") pod \"test-curl-7577-139661739260640\" (UID: \"b63c3675-421f-4953-b86f-6355dce2df2f\") " pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.631575 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.631517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.640681 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.640658    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ff29af-4e37-402e-ba75-0dc96446d463" path="/var/lib/kubelet/pods/51ff29af-4e37-402e-ba75-0dc96446d463/volumes"
Jul 09 19:27:35.768915 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.768892    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:35.770092 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:27:35.770069    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb63c3675_421f_4953_b86f_6355dce2df2f.slice/crio-015541b4afcdb423b3e0a79690bd2936f714cdfac89fe33ee0a313032514ca70 WatchSource:0}: Error finding container 015541b4afcdb423b3e0a79690bd2936f714cdfac89fe33ee0a313032514ca70: Status 404 returned error can't find the container with id 015541b4afcdb423b3e0a79690bd2936f714cdfac89fe33ee0a313032514ca70
Jul 09 19:27:35.989348 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.989325    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:35.989499 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.989399    2578 scope.go:117] "RemoveContainer" containerID="2926366cbae2bd38930cc6fa6be2c4497484a2a03002c9c68524651b5f4d15fb"
Jul 09 19:27:35.990816 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:35.990734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739260640" event={"ID":"b63c3675-421f-4953-b86f-6355dce2df2f","Type":"ContainerStarted","Data":"015541b4afcdb423b3e0a79690bd2936f714cdfac89fe33ee0a313032514ca70"}
Jul 09 19:27:36.997645 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:36.997609    2578 generic.go:356] "Generic (PLEG): container finished" podID="b63c3675-421f-4953-b86f-6355dce2df2f" containerID="323e7ca6b2651a38d05d82c65823d1e5bd3b325ddeb70afeb8e57c00cd57e038" exitCode=0
Jul 09 19:27:36.998084 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:36.997691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7577-139661739260640" event={"ID":"b63c3675-421f-4953-b86f-6355dce2df2f","Type":"ContainerDied","Data":"323e7ca6b2651a38d05d82c65823d1e5bd3b325ddeb70afeb8e57c00cd57e038"}
Jul 09 19:27:38.155461 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.155431    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:38.181205 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.181184    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7577-139661739260640_b63c3675-421f-4953-b86f-6355dce2df2f/test-curl-7577-139661739260640/0.log"
Jul 09 19:27:38.211290 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.211263    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:38.217621 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.217595    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7577-139661739260640"]
Jul 09 19:27:38.217840 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.217822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5w8f\" (UniqueName: \"kubernetes.io/projected/b63c3675-421f-4953-b86f-6355dce2df2f-kube-api-access-n5w8f\") pod \"b63c3675-421f-4953-b86f-6355dce2df2f\" (UID: \"b63c3675-421f-4953-b86f-6355dce2df2f\") "
Jul 09 19:27:38.219877 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.219851    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b63c3675-421f-4953-b86f-6355dce2df2f-kube-api-access-n5w8f" (OuterVolumeSpecName: "kube-api-access-n5w8f") pod "b63c3675-421f-4953-b86f-6355dce2df2f" (UID: "b63c3675-421f-4953-b86f-6355dce2df2f"). InnerVolumeSpecName "kube-api-access-n5w8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:38.319297 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.319245    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5w8f\" (UniqueName: \"kubernetes.io/projected/b63c3675-421f-4953-b86f-6355dce2df2f-kube-api-access-n5w8f\") on node \"ip-10-0-129-245.ec2.internal\" DevicePath \"\""
Jul 09 19:27:38.470611 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.470585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:38.877922 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.877892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:38.978346 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:38.978321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:39.011702 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:39.011680    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:39.011791 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:39.011706    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="015541b4afcdb423b3e0a79690bd2936f714cdfac89fe33ee0a313032514ca70"
Jul 09 19:27:39.022276 ip-10-0-129-245 kubenswrapper[2578]: E0709 19:27:39.022250    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7577-139661739260640\" is forbidden: User \"system:node:ip-10-0-129-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-245.ec2.internal' and this object" podUID="b63c3675-421f-4953-b86f-6355dce2df2f" pod="openshift-ingress/test-curl-7577-139661739260640"
Jul 09 19:27:39.114502 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:39.114466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:39.315491 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:39.315461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:39.640037 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:39.639965    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b63c3675-421f-4953-b86f-6355dce2df2f" path="/var/lib/kubelet/pods/b63c3675-421f-4953-b86f-6355dce2df2f/volumes"
Jul 09 19:27:42.657040 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:42.657001    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:27:45.555982 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:45.555944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:45.653200 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:45.653168    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:45.845069 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:45.844988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.061577 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:46.061545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.249849 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:46.249823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.715015 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:46.714989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.823007 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:46.822978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.921280 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:46.921257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:47.177330 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:47.177304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:53.359764 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:53.359651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:53.459293 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:53.459261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:53.643741 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:53.643660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:53.942156 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:53.942116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:56.547310 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:56.547277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tpsrn"]
Jul 09 19:27:59.699360 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:27:59.699325    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xnvxk_ec0d3b43-4d75-4403-b077-f8ea4a08f1e7/server/0.log"
Jul 09 19:28:00.195075 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:00.195042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-sqh2s_49d15505-2aa1-427d-bbb4-f57b4ed47f22/copy-manifests/0.log"
Jul 09 19:28:00.210875 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:00.210844    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-sqh2s_49d15505-2aa1-427d-bbb4-f57b4ed47f22/manager/0.log"
Jul 09 19:28:00.496466 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:00.496372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:02.190412 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:02.190368    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t6prl_876ce1db-6cb1-417b-8a67-0418c8c4101f/manager/0.log"
Jul 09 19:28:02.306163 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:02.306137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ws2rs_56ee312d-0aaf-41f5-92b5-f5826ade9f01/manager/0.log"
Jul 09 19:28:02.421662 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:02.421637    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8gjrc_24d6add7-6add-487e-a245-335868d5b44e/kuadrant-console-plugin/0.log"
Jul 09 19:28:02.545694 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:02.545627    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wd6dz_a745a36b-96c8-4f28-8dc8-8fdc5b430092/registry-server/0.log"
Jul 09 19:28:02.790563 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:02.790532    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tpsrn_e2163f62-1526-4999-a45b-c4eebbcfb55c/limitador/0.log"
Jul 09 19:28:03.267229 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:03.267201    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44h6bt_80ea3627-3f65-44dc-b54e-7971095e0c27/istio-proxy/0.log"
Jul 09 19:28:03.742891 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:03.742861    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/1.log"
Jul 09 19:28:04.098481 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:04.098401    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf5db78cd-wfx7n_15738328-8650-4356-80f3-199f27ad3c9e/router/0.log"
Jul 09 19:28:04.917965 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:04.917930    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xl9d5_e294a4a9-1226-404e-b211-068c3ab3bb0b/main/0.log"
Jul 09 19:28:05.037114 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:05.037090    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wv4j9_f3905cc4-9186-4ba6-bd3c-ad5e00906348/main/0.log"
Jul 09 19:28:08.747028 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.746992    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b6jw8/must-gather-xwx7f"]
Jul 09 19:28:08.747482 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.747397    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63c3675-421f-4953-b86f-6355dce2df2f" containerName="test-curl-7577-139661739260640"
Jul 09 19:28:08.747482 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.747409    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63c3675-421f-4953-b86f-6355dce2df2f" containerName="test-curl-7577-139661739260640"
Jul 09 19:28:08.747482 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.747473    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b63c3675-421f-4953-b86f-6355dce2df2f" containerName="test-curl-7577-139661739260640"
Jul 09 19:28:08.750669 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.750649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:08.753990 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.753969    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6jw8\"/\"openshift-service-ca.crt\""
Jul 09 19:28:08.755796 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.755774    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b6jw8\"/\"default-dockercfg-fk46d\""
Jul 09 19:28:08.755796 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.755789    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6jw8\"/\"kube-root-ca.crt\""
Jul 09 19:28:08.760289 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.760267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6jw8/must-gather-xwx7f"]
Jul 09 19:28:08.760602 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.760583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:08.787213 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.787189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rj7k\" (UniqueName: \"kubernetes.io/projected/7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9-kube-api-access-6rj7k\") pod \"must-gather-xwx7f\" (UID: \"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9\") " pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:08.787296 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.787218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9-must-gather-output\") pod \"must-gather-xwx7f\" (UID: \"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9\") " pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:08.857202 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.857176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:08.887816 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.887787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rj7k\" (UniqueName: \"kubernetes.io/projected/7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9-kube-api-access-6rj7k\") pod \"must-gather-xwx7f\" (UID: \"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9\") " pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:08.887910 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.887823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9-must-gather-output\") pod \"must-gather-xwx7f\" (UID: \"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9\") " pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:08.888150 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.888134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9-must-gather-output\") pod \"must-gather-xwx7f\" (UID: \"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9\") " pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:08.904571 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:08.904550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rj7k\" (UniqueName: \"kubernetes.io/projected/7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9-kube-api-access-6rj7k\") pod \"must-gather-xwx7f\" (UID: \"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9\") " pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:09.060890 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:09.060835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6jw8/must-gather-xwx7f"
Jul 09 19:28:09.198768 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:09.198740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6jw8/must-gather-xwx7f"]
Jul 09 19:28:09.200482 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:28:09.200454    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c5cf3f4_cdfb_49e2_9e79_7da6655b1db9.slice/crio-ed372ce873d8302959e105aadd479aaba6c7cf59d8fd4b1b9dcdee4ffabc8fdb WatchSource:0}: Error finding container ed372ce873d8302959e105aadd479aaba6c7cf59d8fd4b1b9dcdee4ffabc8fdb: Status 404 returned error can't find the container with id ed372ce873d8302959e105aadd479aaba6c7cf59d8fd4b1b9dcdee4ffabc8fdb
Jul 09 19:28:10.182412 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:10.182354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/must-gather-xwx7f" event={"ID":"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9","Type":"ContainerStarted","Data":"2429e410d3be9ac44b00f21c95ff4fc8d1a07f2385359848db290a6b710f96f0"}
Jul 09 19:28:10.182412 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:10.182411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/must-gather-xwx7f" event={"ID":"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9","Type":"ContainerStarted","Data":"cbf5c0defb53d27fcd938f8d27e2dc4914f322cab012cfed77a64b85a31ed919"}
Jul 09 19:28:10.182911 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:10.182425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/must-gather-xwx7f" event={"ID":"7c5cf3f4-cdfb-49e2-9e79-7da6655b1db9","Type":"ContainerStarted","Data":"ed372ce873d8302959e105aadd479aaba6c7cf59d8fd4b1b9dcdee4ffabc8fdb"}
Jul 09 19:28:10.204297 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:10.204192    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b6jw8/must-gather-xwx7f" podStartSLOduration=1.470570049 podStartE2EDuration="2.204176199s" totalImagesPullingTime="733.60615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:28:10.202260917 +0000 UTC m=+2803.011107352" watchObservedRunningTime="2026-07-09 19:28:10.204176199 +0000 UTC m=+2803.013022633"
Jul 09 19:28:11.559693 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:11.559662    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2kztj_809f082e-d099-4758-b605-f4d76eedd980/global-pull-secret-syncer/0.log"
Jul 09 19:28:11.715130 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:11.715090    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log"
Jul 09 19:28:11.803124 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:11.803079    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-245.ec2.internal_3c268e93e8c7930ec1c5d8f84479e66a/haproxy/0.log"
Jul 09 19:28:16.401168 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:16.401127    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t6prl_876ce1db-6cb1-417b-8a67-0418c8c4101f/manager/0.log"
Jul 09 19:28:16.432403 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:16.432356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ws2rs_56ee312d-0aaf-41f5-92b5-f5826ade9f01/manager/0.log"
Jul 09 19:28:16.471057 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:16.471031    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8gjrc_24d6add7-6add-487e-a245-335868d5b44e/kuadrant-console-plugin/0.log"
Jul 09 19:28:16.519513 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:16.519485    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wd6dz_a745a36b-96c8-4f28-8dc8-8fdc5b430092/registry-server/0.log"
Jul 09 19:28:16.550008 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:16.549953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbqlb_cc95cb71-a45f-4706-9302-bc7a09bcbc73/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:16.667490 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:16.667362    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tpsrn_e2163f62-1526-4999-a45b-c4eebbcfb55c/limitador/0.log"
Jul 09 19:28:18.484622 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.484590    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/alertmanager/0.log"
Jul 09 19:28:18.518501 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.518451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/config-reloader/0.log"
Jul 09 19:28:18.556661 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.556638    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/kube-rbac-proxy-web/0.log"
Jul 09 19:28:18.597533 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.597484    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/kube-rbac-proxy/0.log"
Jul 09 19:28:18.627267 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.627241    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/kube-rbac-proxy-metric/0.log"
Jul 09 19:28:18.663738 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.663694    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/prom-label-proxy/0.log"
Jul 09 19:28:18.706510 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.706481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0dad6272-0ab0-470c-ab98-713a42bc7dca/init-config-reloader/0.log"
Jul 09 19:28:18.947669 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:18.947604    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cbf44df87-22bff_cfbae5b6-95e7-4294-ad08-ff87b29021c1/metrics-server/0.log"
Jul 09 19:28:19.260310 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.260182    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lln5z_901d31b1-5e8c-4d21-996e-c86fa62c5b0f/node-exporter/0.log"
Jul 09 19:28:19.287531 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.287497    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lln5z_901d31b1-5e8c-4d21-996e-c86fa62c5b0f/kube-rbac-proxy/0.log"
Jul 09 19:28:19.314697 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.314664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lln5z_901d31b1-5e8c-4d21-996e-c86fa62c5b0f/init-textfile/0.log"
Jul 09 19:28:19.349166 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.349118    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-t87sh_5137ceed-0af1-4527-9ebd-864d213caefc/kube-rbac-proxy-main/0.log"
Jul 09 19:28:19.377538 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.377500    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-t87sh_5137ceed-0af1-4527-9ebd-864d213caefc/kube-rbac-proxy-self/0.log"
Jul 09 19:28:19.404274 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.404244    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-t87sh_5137ceed-0af1-4527-9ebd-864d213caefc/openshift-state-metrics/0.log"
Jul 09 19:28:19.659644 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.659571    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-pbbx8_4adbb3df-7225-40ea-ad7f-8ad294e36d65/prometheus-operator/0.log"
Jul 09 19:28:19.702760 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.702734    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-pbbx8_4adbb3df-7225-40ea-ad7f-8ad294e36d65/kube-rbac-proxy/0.log"
Jul 09 19:28:19.738688 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.738653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-24r26_67bb3078-e228-4a42-959f-5216834ef670/prometheus-operator-admission-webhook/0.log"
Jul 09 19:28:19.775595 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.775556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75644fdfc6-m2vgh_0a7127ab-0cf7-496d-a179-43e2571bdd3c/telemeter-client/0.log"
Jul 09 19:28:19.802633 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.802607    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75644fdfc6-m2vgh_0a7127ab-0cf7-496d-a179-43e2571bdd3c/reload/0.log"
Jul 09 19:28:19.828958 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.828931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75644fdfc6-m2vgh_0a7127ab-0cf7-496d-a179-43e2571bdd3c/kube-rbac-proxy/0.log"
Jul 09 19:28:19.863919 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.863884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff4dbdd9-pxdsf_6987aba0-070f-4afd-86ab-e3fd89bc7b5d/thanos-query/0.log"
Jul 09 19:28:19.889294 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.889268    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff4dbdd9-pxdsf_6987aba0-070f-4afd-86ab-e3fd89bc7b5d/kube-rbac-proxy-web/0.log"
Jul 09 19:28:19.915506 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.915427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff4dbdd9-pxdsf_6987aba0-070f-4afd-86ab-e3fd89bc7b5d/kube-rbac-proxy/0.log"
Jul 09 19:28:19.952680 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.952651    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff4dbdd9-pxdsf_6987aba0-070f-4afd-86ab-e3fd89bc7b5d/prom-label-proxy/0.log"
Jul 09 19:28:19.979764 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:19.979734    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff4dbdd9-pxdsf_6987aba0-070f-4afd-86ab-e3fd89bc7b5d/kube-rbac-proxy-rules/0.log"
Jul 09 19:28:20.016290 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:20.016262    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff4dbdd9-pxdsf_6987aba0-070f-4afd-86ab-e3fd89bc7b5d/kube-rbac-proxy-metrics/0.log"
Jul 09 19:28:21.276713 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.276675    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"]
Jul 09 19:28:21.284814 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.284783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.288566 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.288531    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"]
Jul 09 19:28:21.443483 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.443448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-sys\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.443785 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.443538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-lib-modules\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.443785 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.443586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-podres\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.443785 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.443627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkkcw\" (UniqueName: \"kubernetes.io/projected/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-kube-api-access-pkkcw\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.443785 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.443654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-proc\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545237 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkkcw\" (UniqueName: \"kubernetes.io/projected/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-kube-api-access-pkkcw\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545237 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-proc\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545472 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-sys\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545472 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-lib-modules\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545577 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-podres\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545577 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-sys\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545577 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-proc\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545726 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-lib-modules\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.545726 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.545643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-podres\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.557071 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.557033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkkcw\" (UniqueName: \"kubernetes.io/projected/3a3e0e4f-d42c-48e2-86b3-1523d5aa52df-kube-api-access-pkkcw\") pod \"perf-node-gather-daemonset-4cb2j\" (UID: \"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.598597 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.598566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:21.797047 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.797016    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"]
Jul 09 19:28:21.798757 ip-10-0-129-245 kubenswrapper[2578]: W0709 19:28:21.798710    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a3e0e4f_d42c_48e2_86b3_1523d5aa52df.slice/crio-466f7b20df20eb1a5f187094a79f5d5c24886c0e371a1d46d86170a5a75ace8d WatchSource:0}: Error finding container 466f7b20df20eb1a5f187094a79f5d5c24886c0e371a1d46d86170a5a75ace8d: Status 404 returned error can't find the container with id 466f7b20df20eb1a5f187094a79f5d5c24886c0e371a1d46d86170a5a75ace8d
Jul 09 19:28:21.924201 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.924140    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/1.log"
Jul 09 19:28:21.930777 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:21.930747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wk2mx_b06cb015-480d-4404-8465-34535cd2e097/console-operator/2.log"
Jul 09 19:28:22.273175 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:22.273132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j" event={"ID":"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df","Type":"ContainerStarted","Data":"eeaeb1e1fa37d09ded49b5ae7735859d2857df5e7d0932d93d53fe7e771c5074"}
Jul 09 19:28:22.273373 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:22.273204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j" event={"ID":"3a3e0e4f-d42c-48e2-86b3-1523d5aa52df","Type":"ContainerStarted","Data":"466f7b20df20eb1a5f187094a79f5d5c24886c0e371a1d46d86170a5a75ace8d"}
Jul 09 19:28:22.274102 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:22.274076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:22.294095 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:22.294038    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j" podStartSLOduration=1.294021654 podStartE2EDuration="1.294021654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:28:22.293503867 +0000 UTC m=+2815.102350302" watchObservedRunningTime="2026-07-09 19:28:22.294021654 +0000 UTC m=+2815.102868092"
Jul 09 19:28:23.091370 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:23.091337    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-2s96p_a18d879f-c50e-4e3d-a0ba-f14a8e129dfa/volume-data-source-validator/0.log"
Jul 09 19:28:24.293799 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:24.293761    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9nl2t_b9e5163a-39af-4af8-a583-c09d52cfe568/dns/0.log"
Jul 09 19:28:24.321665 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:24.321627    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9nl2t_b9e5163a-39af-4af8-a583-c09d52cfe568/kube-rbac-proxy/0.log"
Jul 09 19:28:24.375639 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:24.375604    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tnbw4_ff676955-44dc-425e-8060-3baca082807a/dns-node-resolver/0.log"
Jul 09 19:28:25.004131 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:25.004101    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7458cc6ddf-5f2hl_eec638a8-0c17-446e-84cb-5c3c5e591e67/registry/0.log"
Jul 09 19:28:25.029302 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:25.029281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lv4fg_8751e110-a548-4539-8e9b-6748fdf7e246/node-ca/0.log"
Jul 09 19:28:26.078528 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:26.078495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44h6bt_80ea3627-3f65-44dc-b54e-7971095e0c27/istio-proxy/0.log"
Jul 09 19:28:26.299624 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:26.299585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/0.log"
Jul 09 19:28:26.344245 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:26.344154    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/1.log"
Jul 09 19:28:26.434191 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:26.434162    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf5db78cd-wfx7n_15738328-8650-4356-80f3-199f27ad3c9e/router/0.log"
Jul 09 19:28:27.163797 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:27.163754    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8rc8w_76444cae-583d-4ea3-a256-1f7e025a1397/serve-healthcheck-canary/0.log"
Jul 09 19:28:27.735160 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:27.735130    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-qwdbq_a4a760bd-aa99-493a-b090-663f814d45da/insights-operator/0.log"
Jul 09 19:28:27.735900 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:27.735874    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-qwdbq_a4a760bd-aa99-493a-b090-663f814d45da/insights-operator/1.log"
Jul 09 19:28:27.763352 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:27.763315    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8745v_6eacc620-d573-4101-aa52-c8a9937f88de/kube-rbac-proxy/0.log"
Jul 09 19:28:27.791645 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:27.791624    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8745v_6eacc620-d573-4101-aa52-c8a9937f88de/exporter/0.log"
Jul 09 19:28:27.819628 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:27.819589    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8745v_6eacc620-d573-4101-aa52-c8a9937f88de/extractor/0.log"
Jul 09 19:28:29.294709 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:29.294675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-4cb2j"
Jul 09 19:28:30.601168 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:30.601092    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xnvxk_ec0d3b43-4d75-4403-b077-f8ea4a08f1e7/server/0.log"
Jul 09 19:28:30.921434 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:30.921401    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-sqh2s_49d15505-2aa1-427d-bbb4-f57b4ed47f22/manager/0.log"
Jul 09 19:28:30.943570 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:30.943540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-sqh2s_49d15505-2aa1-427d-bbb4-f57b4ed47f22/copy-manifests/0.log"
Jul 09 19:28:31.643415 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:31.643303    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44h6bt_80ea3627-3f65-44dc-b54e-7971095e0c27/istio-proxy/0.log"
Jul 09 19:28:31.821496 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:31.821465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/0.log"
Jul 09 19:28:31.862079 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:31.862048    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/1.log"
Jul 09 19:28:31.920830 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:31.920799    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf5db78cd-wfx7n_15738328-8650-4356-80f3-199f27ad3c9e/router/0.log"
Jul 09 19:28:32.262047 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:32.261964    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68b945dcf-vjbqp_2993b8fb-6c8b-4d7d-a1c7-785c1bbc640d/manager/0.log"
Jul 09 19:28:33.179355 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:33.179315    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44h6bt_80ea3627-3f65-44dc-b54e-7971095e0c27/istio-proxy/0.log"
Jul 09 19:28:33.363657 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:33.363568    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/0.log"
Jul 09 19:28:33.406658 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:33.406623    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xbnnl_5768b918-c6ad-4dbf-9c94-26a87992d1ca/istio-proxy/1.log"
Jul 09 19:28:33.468203 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:33.468174    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf5db78cd-wfx7n_15738328-8650-4356-80f3-199f27ad3c9e/router/0.log"
Jul 09 19:28:37.486040 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:37.486009    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-jpq8r_ca42099a-1aef-4dd3-ab1d-ab08fd69270f/migrator/0.log"
Jul 09 19:28:37.534544 ip-10-0-129-245 kubenswrapper[2578]: I0709 19:28:37.534515    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-jpq8r_ca42099a-1aef-4dd3-ab1d-ab08fd69270f/graceful-termination/0.log"