Jul 24 19:34:44.544014 ip-10-0-130-158 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 19:34:44.923117 ip-10-0-130-158 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:34:44.923117 ip-10-0-130-158 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 19:34:44.923117 ip-10-0-130-158 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:34:44.923117 ip-10-0-130-158 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 19:34:44.923117 ip-10-0-130-158 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 19:34:44.924150 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.924070    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 19:34:44.929504 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929487    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:44.929504 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929500    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:44.929504 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929507    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929512    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929518    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929521    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929526    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929530    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929533    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929538    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929542    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929546    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929550    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929555    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929559    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929563    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929569    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929573    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929584    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929589    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929592    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:44.929694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929596    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929601    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929605    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929609    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929612    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929616    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929621    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929625    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929629    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929634    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929638    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929642    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929649    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929655    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929660    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929666    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929671    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929676    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929680    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:44.930479 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929685    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929691    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929697    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929702    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929706    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929711    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929715    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929719    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929723    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929728    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929732    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929736    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929754    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929759    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929763    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929777    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929782    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929786    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929791    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929795    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:44.931328 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929800    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929804    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929809    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929813    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929817    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929821    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929825    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929830    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929834    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929839    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929843    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929848    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929853    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929859    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929863    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929867    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929872    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929876    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929880    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929884    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:44.932019 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929889    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929892    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929896    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929903    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929908    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929913    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929919    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929924    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929929    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929933    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929938    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929943    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929948    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929952    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929956    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929960    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929965    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929968    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.929973    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:44.932489 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931107    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931117    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931122    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931126    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931130    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931136    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931141    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931145    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931150    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931154    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931158    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931162    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931167    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931171    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931175    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931180    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931187    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931194    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931199    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931204    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:44.932956 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931209    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931214    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931218    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931222    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931227    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931231    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931235    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931239    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931243    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931247    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931251    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931255    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931261    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931265    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931269    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931273    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931277    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931281    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931294    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:44.933432 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931299    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931303    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931307    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931311    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931315    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931320    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931324    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931327    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931331    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931335    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931339    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931343    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931346    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931351    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931355    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931360    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931364    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931369    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931373    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931377    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:44.933911 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931381    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931386    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931390    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931394    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931398    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931402    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931407    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931410    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931415    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931419    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931423    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931427    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931433    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931437    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931441    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931445    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931449    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931454    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931458    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931462    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:44.934383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931466    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931470    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931476    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931482    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931488    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931493    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931498    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931503    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931507    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931513    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931518    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931522    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931526    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931531    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931535    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931539    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931543    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931548    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931552    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:44.934880 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.931556    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932030    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932040    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932043    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932046    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932050    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932052    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932055    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932058    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932060    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932063    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932067    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932069    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932073    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932077    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932080    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932085    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932089    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932093    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:44.935362 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932096    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932099    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932102    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932105    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932108    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932110    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932113    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932116    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932118    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932120    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932123    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932125    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932128    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932131    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932133    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932137    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932140    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932143    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932145    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932148    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:44.935822 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932151    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932153    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932156    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932158    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932161    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932163    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932165    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932168    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932171    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932173    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932175    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932178    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932180    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932182    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932186    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932189    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932191    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932194    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932196    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932199    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:44.936294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932201    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932204    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932206    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932209    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932211    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932214    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932217    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932220    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932223    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932226    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932228    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932231    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932234    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932237    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932240    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932242    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932245    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932248    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932250    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932253    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:44.936821 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932255    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932258    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932260    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932263    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932265    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932268    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932270    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932273    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932275    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932278    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932281    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932283    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932285    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932288    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932290    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932293    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932295    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932298    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932300    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932303    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:44.937294 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932305    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932371    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932378    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932384    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932388    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932392    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932395    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932399    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932403    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932406    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932409    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932413    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932416    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932419    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932421    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932424    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932427    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932430    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932433    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932437    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932440    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932443    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932446    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932449    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 19:34:44.937787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932452    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932455    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932458    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932462    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932464    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932467    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932470    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932473    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932476    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932480    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932483    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932485    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932488    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932491    2560 flags.go:64] FLAG: --enable-server="true"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932495    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932499    2560 flags.go:64] FLAG: --event-burst="100"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932502    2560 flags.go:64] FLAG: --event-qps="50"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932505    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932507    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932510    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932516    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932518    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932521    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932524    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932529    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 19:34:44.938379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932533    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932535    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932538    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932541    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932544    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932546    2560 flags.go:64] FLAG: --feature-gates=""
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932550    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932553    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932556    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932559    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932562    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932564    2560 flags.go:64] FLAG: --help="false"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932567    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-158.ec2.internal"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932570    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932573    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932576    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932581    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932584    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932587    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932589    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932592    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932595    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932598    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932601    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 19:34:44.939079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932604    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932607    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932610    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932613    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932615    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932618    2560 flags.go:64] FLAG: --lock-file=""
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932621    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932625    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932628    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932633    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932636    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932639    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932642    2560 flags.go:64] FLAG: --logging-format="text"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932644    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932648    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932651    2560 flags.go:64] FLAG: --manifest-url=""
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932654    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932658    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932661    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932665    2560 flags.go:64] FLAG: --max-pods="110"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932668    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932671    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932675    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932678    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932681    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 19:34:44.939669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932684    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932687    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932694    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932697    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932700    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932703    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932706    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932711    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932714    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932717    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932720    2560 flags.go:64] FLAG: --port="10250"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932723    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932726    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0833d5eef3f953070"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932729    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932733    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932736    2560 flags.go:64] FLAG: --register-node="true"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932739    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932755    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932758    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932762    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932764    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932768    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932771    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932774    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932777    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 19:34:44.940292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932780    2560 flags.go:64] FLAG: --runonce="false"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932783    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932786    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932789    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932792    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932796    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932799    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932802    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932805    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932808    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932810    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932813    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932816    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932819    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932822    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932825    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932830    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932833    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932836    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932840    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932843    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932847    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932850    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932853    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932856    2560 flags.go:64] FLAG: --v="2"
Jul 24 19:34:44.940918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932859    2560 flags.go:64] FLAG: --version="false"
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932863    2560 flags.go:64] FLAG: --vmodule=""
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932872    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.932876    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932985    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932989    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932991    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932994    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.932997    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933000    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933003    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933006    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933010    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933014    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933018    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933021    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933024    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933027    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933031    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:44.941545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933034    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933037    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933040    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933043    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933046    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933048    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933051    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933054    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933056    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933060    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933063    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933065    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933068    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933070    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933073    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933075    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933078    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933081    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933083    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933086    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:44.942017 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933088    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933091    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933093    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933096    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933099    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933103    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933105    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933108    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933110    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933113    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933116    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933118    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933121    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933123    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933126    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933128    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933131    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933134    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933136    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933139    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:44.942496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933141    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933145    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933148    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933150    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933153    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933155    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933158    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933160    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933163    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933165    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933168    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933170    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933173    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933175    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933178    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933180    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933183    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933187    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933190    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933193    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:44.943067 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933195    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933198    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933200    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933203    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933205    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933208    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933210    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933213    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933215    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933218    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933221    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933223    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933227    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933232    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933235    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933237    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933240    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933243    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933245    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:44.943545 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933248    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933251    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933253    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933256    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.933258    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.933264    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.939902    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.939917    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.941141    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.941149    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941202    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941207    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941210    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941213    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941216    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:44.944023 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941219    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941222    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941225    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941227    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941230    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941233    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941237    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941240    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941244    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941246    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941249    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941252    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941254    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941257    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941259    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941262    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941265    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941267    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941270    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:44.944383 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941273    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941275    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941277    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941280    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941282    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941286    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941289    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941291    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941294    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941296    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941299    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941301    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941304    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941306    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941309    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941311    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941314    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941316    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941319    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941321    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:44.944841 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941323    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941326    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941328    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941331    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941334    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941336    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941339    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941341    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941344    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941347    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941349    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941352    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941354    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941357    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941360    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941362    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941365    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941368    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941371    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941374    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:44.945309 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941376    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941380    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941383    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941386    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941389    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941391    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941394    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941397    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941399    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941402    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941405    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941407    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941410    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941412    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941415    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941417    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941420    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941422    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941425    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:44.945789 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941427    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941431    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941434    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941437    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941441    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941444    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941447    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941451    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941453    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941456    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941458    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941461    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941464    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941466    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941469    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:44.946243 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941471    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.941476    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941582    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941587    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941590    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941593    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941596    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941599    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941602    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941604    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941607    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941610    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941613    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941615    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941618    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 19:34:44.946598 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941620    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941622    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941625    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941627    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941630    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941633    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941636    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941638    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941642    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941646    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941649    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941652    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941654    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941657    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941659    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941662    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941665    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941668    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941670    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 19:34:44.946975 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941672    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941676    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941679    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941682    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941685    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941688    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941691    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941693    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941696    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941698    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941701    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941704    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941706    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941709    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941712    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941715    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941717    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941719    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941722    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941725    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 19:34:44.947433 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941727    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941730    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941732    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941735    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941737    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941750    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941753    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941756    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941758    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941762    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941764    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941767    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941770    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941772    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941775    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941777    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941780    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941783    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941787    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941789    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 19:34:44.947981 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941792    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941795    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941797    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941800    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941802    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941805    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941807    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941810    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941812    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941815    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941818    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941820    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941823    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941825    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941828    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941830    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941833    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941835    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941837    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 19:34:44.948447 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941840    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941843    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941845    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941848    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941851    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941853    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941855    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:44.941858    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.941862    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.941953    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.943910    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.945441    2560 server.go:1019] "Starting client certificate rotation"
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.945534    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:34:44.949010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.945593    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 19:34:44.949523 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.947823    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:34:44.953546 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.953528    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 19:34:44.965137 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.965117    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 24 19:34:44.967029 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.967002    2560 log.go:25] "Validated CRI v1 image API"
Jul 24 19:34:44.967759 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.967726    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 19:34:44.971163 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.971147    2560 fs.go:135] Filesystem UUIDs: map[2c5a6cfc-9ff1-49fa-bfa1-7cf0ebf0d9f2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 98b17bd8-52c3-4835-b44e-d27aca51333d:/dev/nvme0n1p4]
Jul 24 19:34:44.971209 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.971163    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 19:34:44.973065 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.973047    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:34:44.976075 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.975985    2560 manager.go:216] Machine: {Timestamp:2026-07-24 19:34:44.974763925 +0000 UTC m=+0.321741080 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096268 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ae7f085f22e272789445f955764a9 SystemUUID:ec2ae7f0-85f2-2e27-2789-445f955764a9 BootID:2bcbddcf-d90c-4380-b2d6-bf6025759f47 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:3b:ff:9b:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:3b:ff:9b:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:2b:7a:65:98:de Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 19:34:44.976075 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.976074    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 19:34:44.976176 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.976140    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 19:34:44.977188 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.977153    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 19:34:44.977331 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.977199    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 19:34:44.977970 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.977960    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 19:34:44.978005 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.977973    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 19:34:44.978005 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.977980    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:34:44.978513 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.978504    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 19:34:44.979782 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.979771    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 19:34:44.982354 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982343    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:34:44.982469 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982460    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 19:34:44.982500 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982490    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 19:34:44.982535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982501    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 19:34:44.982535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982511    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 19:34:44.982535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982520    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 24 19:34:44.982535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982529    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 19:34:44.982859 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982841    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:34:44.982859 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.982862    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 19:34:44.985530 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.985512    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 19:34:44.987248 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.987233    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 19:34:44.987320 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.987264    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 19:34:44.990830 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990810    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 19:34:44.990905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990837    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 19:34:44.990905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990848    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 19:34:44.990905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990857    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 19:34:44.990905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990871    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 19:34:44.990905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990889    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 19:34:44.990905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990904    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 19:34:44.991171 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990915    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 19:34:44.991171 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990928    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 19:34:44.991171 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990939    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 19:34:44.991171 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990952    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 19:34:44.991171 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.990961    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 19:34:44.991902 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.991882    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 19:34:44.991976 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.991911    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 19:34:44.993008 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:44.992985    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 19:34:44.993074 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:44.993029    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 19:34:44.995039 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.995025    2560 server.go:1268] "Started kubelet"
Jul 24 19:34:44.995118 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.995094    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 19:34:44.995206 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.995161    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 19:34:44.995245 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.995230    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 19:34:44.995703 ip-10-0-130-158 systemd[1]: Started Kubernetes Kubelet.
Jul 24 19:34:44.995954 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.995932    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8bctf"
Jul 24 19:34:44.996240 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.996212    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 19:34:44.997315 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:44.997301    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 19:34:44.999684 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:44.999668    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 19:34:45.003180 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.003163    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 19:34:45.003180 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.003172    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 19:34:45.003679 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.003329    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:45.003910 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.003893    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 19:34:45.003988 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.003893    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 19:34:45.003988 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.003924    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 19:34:45.003988 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.003912    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8bctf"
Jul 24 19:34:45.004128 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004035    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 19:34:45.004128 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004044    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 19:34:45.004211 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004186    2560 factory.go:153] Registering CRI-O factory
Jul 24 19:34:45.004211 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004198    2560 factory.go:223] Registration of the crio container factory successfully
Jul 24 19:34:45.004296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004238    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 19:34:45.004296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004246    2560 factory.go:55] Registering systemd factory
Jul 24 19:34:45.004296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004253    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 24 19:34:45.004296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004276    2560 factory.go:103] Registering Raw factory
Jul 24 19:34:45.004296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004289    2560 manager.go:1196] Started watching for new ooms in manager
Jul 24 19:34:45.004733 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.004719    2560 manager.go:349] Starting recovery of all containers
Jul 24 19:34:45.005446 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.004474    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-158.ec2.internal.18c550d0ca0490dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-158.ec2.internal,UID:ip-10-0-130-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-158.ec2.internal,},FirstTimestamp:2026-07-24 19:34:44.994986205 +0000 UTC m=+0.341963362,LastTimestamp:2026-07-24 19:34:44.994986205 +0000 UTC m=+0.341963362,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-158.ec2.internal,}"
Jul 24 19:34:45.005562 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.005546    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 19:34:45.008831 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.008799    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 19:34:45.009009 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.008953    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 19:34:45.015073 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.015056    2560 manager.go:354] Recovery completed
Jul 24 19:34:45.020928 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.020914    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.022726 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.022710    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.022804 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.022754    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.022804 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.022769    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.023250 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.023237    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 19:34:45.023250 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.023250    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 19:34:45.023324 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.023263    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 19:34:45.023324 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.023238    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.024024 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.024006    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.024094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.024034    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.024094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.024044    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.025097 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.025087    2560 policy_none.go:49] "None policy: Start"
Jul 24 19:34:45.025139 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.025101    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 19:34:45.025139 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.025111    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 19:34:45.026074 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.026064    2560 policy_none.go:47] "Start"
Jul 24 19:34:45.066348 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066244    2560 manager.go:337] "Starting Device Plugin manager"
Jul 24 19:34:45.066439 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.066359    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 19:34:45.066439 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066371    2560 server.go:87] "Starting device plugin registration server"
Jul 24 19:34:45.066589 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066576    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 19:34:45.066642 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066590    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 19:34:45.066685 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066674    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 19:34:45.066773 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066759    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 19:34:45.066773 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.066771    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 19:34:45.067219 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.067199    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 19:34:45.067293 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.067253    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:45.132359 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.132332    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 19:34:45.133928 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.133476    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 19:34:45.133928 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.133517    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 19:34:45.133928 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.133544    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 19:34:45.133928 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.133582    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 19:34:45.136372 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.136354    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:45.166886 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.166870    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.168557 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.168541    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.168627 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.168569    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.168627 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.168586    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.168627 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.168609    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.175410 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.175370    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.175410 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.175390    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-158.ec2.internal\": node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:45.189822 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.189803    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:45.234076 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.234057    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"]
Jul 24 19:34:45.234145 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.234110    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.237355 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.237336    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.237429 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.237363    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.237429 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.237375    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.239163 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239150    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.239298 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.239341 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239314    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.239870 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239853    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.239924 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239882    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.239924 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239892    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.239992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239853    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.239992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239961    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.239992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.239981    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.241753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.241729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.241804 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.241771    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 19:34:45.242509 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.242486    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 19:34:45.242568 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.242524    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 19:34:45.242568 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.242540    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID"
Jul 24 19:34:45.271341 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.271322    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-158.ec2.internal\" not found" node="ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.275512 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.275499    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-158.ec2.internal\" not found" node="ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.290342 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.290321    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:45.305955 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.305932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6170be9fef07e697dd1374e418f97f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"d6170be9fef07e697dd1374e418f97f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.306036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.305959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6170be9fef07e697dd1374e418f97f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"d6170be9fef07e697dd1374e418f97f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.306036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.305974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f041e38e0008b1154b43505cb789167-config\") pod \"kube-apiserver-proxy-ip-10-0-130-158.ec2.internal\" (UID: \"0f041e38e0008b1154b43505cb789167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.391296 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:45.391277    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:45.406696 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.406670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f041e38e0008b1154b43505cb789167-config\") pod \"kube-apiserver-proxy-ip-10-0-130-158.ec2.internal\" (UID: \"0f041e38e0008b1154b43505cb789167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.406696 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.406702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6170be9fef07e697dd1374e418f97f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"d6170be9fef07e697dd1374e418f97f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.406845 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.406717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6170be9fef07e697dd1374e418f97f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"d6170be9fef07e697dd1374e418f97f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.406845 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.406775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6170be9fef07e697dd1374e418f97f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"d6170be9fef07e697dd1374e418f97f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.406845 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.406785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f041e38e0008b1154b43505cb789167-config\") pod \"kube-apiserver-proxy-ip-10-0-130-158.ec2.internal\" (UID: \"0f041e38e0008b1154b43505cb789167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:45.406845 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:45.406797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6170be9fef07e697dd1374e418f97f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"d6170be9fef07e697dd1374e418f97f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:47.194806 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.194770    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:47.276255 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.276229    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:47.281571 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.281552    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:47.295803 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.295786    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:47.396295 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.396275    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:47.496853 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.496807    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found"
Jul 24 19:34:47.574557 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.574541    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:47.606567 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.606549    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:47.618422 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.618403    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:34:47.620087 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.620073    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"
Jul 24 19:34:47.628027 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.628012    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 19:34:47.647205 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.647185    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 19:34:47.647316 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.647299    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:34:47.647365 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.647336    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 19:34:47.685501 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.685485    2560 apiserver.go:52] "Watching apiserver"
Jul 24 19:34:47.705472 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.705440    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:47.707081 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.706995    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 19:34:47.707379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.707362    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 19:34:47.709968 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.709948    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-qcg29","openshift-ovn-kubernetes/ovnkube-node-pgjmb","kube-system/global-pull-secret-syncer-j464j","kube-system/konnectivity-agent-htbcl","kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bqtjj","openshift-dns/node-resolver-9km98","openshift-image-registry/node-ca-f55bq","openshift-multus/multus-additional-cni-plugins-rfrf7","openshift-multus/multus-dt7lg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal","openshift-multus/network-metrics-daemon-d8vms","openshift-network-diagnostics/network-check-target-nwdnf"]
Jul 24 19:34:47.711251 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.711216    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 19:29:46 +0000 UTC" deadline="2028-01-28 05:16:46.014919325 +0000 UTC"
Jul 24 19:34:47.711301 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.711251    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13257h41m58.303670946s"
Jul 24 19:34:47.712031 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.712020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.713835 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.713819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.714282 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.714265    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lpf67\""
Jul 24 19:34:47.714447 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.714431    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.714539 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.714447    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.715607 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.715591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:47.715686 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.715666    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:47.716271 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.716258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.716443 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.716425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.716744 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.716726    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 19:34:47.716744 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.716738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fpjtv\""
Jul 24 19:34:47.717514 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.717499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.719395 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.719379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.719841 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.719823    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 19:34:47.719841 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.719839    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 19:34:47.719956 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.719944    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r5vpf\""
Jul 24 19:34:47.720099 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.720086    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 19:34:47.721346 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.721331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.722030 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.722013    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6kqlf\""
Jul 24 19:34:47.722089 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.722015    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.722089 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.722046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.722160 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.722018    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 19:34:47.723360 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.723345    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.723664 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.723649    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.723933 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.723918    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2fh2\""
Jul 24 19:34:47.723996 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.723970    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.725749 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.725734    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 19:34:47.725817 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.725776    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 19:34:47.726059 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.726042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:47.726129 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.726095    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.726129 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.726109    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 19:34:47.726231 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.726133    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.726231 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.726143    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:47.726432 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.726418    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gzgh\""
Jul 24 19:34:47.728444 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.728426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.730598 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.730580    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.730980 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.730964    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jr95r\""
Jul 24 19:34:47.731067 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.731053    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 19:34:47.732527 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.732499    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 19:34:47.732609 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.732530    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 19:34:47.732609 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.732547    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.732609 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.732499    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.732609 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.732601    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 19:34:47.732874 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.732861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.733102 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.733081    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 19:34:47.733313 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.733299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kkljn\""
Jul 24 19:34:47.735314 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.735300    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 19:34:47.735547 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.735528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.735642 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.735572    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 19:34:47.735642 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.735583    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:34:47.735642 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.735598    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:34:47.735642 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.735593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gmvcn\""
Jul 24 19:34:47.744868 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.744850    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4b2tc"
Jul 24 19:34:47.750850 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.750803    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4b2tc"
Jul 24 19:34:47.807543 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.807527    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 19:34:47.813817 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-device-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.813915 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-sys\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.813915 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:47.813915 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.813915 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.814094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-os-release\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.814094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.813983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-netns\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.814094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-systemd-units\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24cec716-6bc2-4ba8-b6c9-0d7ab89baff7-agent-certs\") pod \"konnectivity-agent-htbcl\" (UID: \"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7\") " pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.814094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-sys-fs\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.814094 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-lib-modules\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lwr\" (UniqueName: \"kubernetes.io/projected/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-kube-api-access-r7lwr\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-systemd\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-ovn\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-cni-netd\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24cec716-6bc2-4ba8-b6c9-0d7ab89baff7-konnectivity-ca\") pod \"konnectivity-agent-htbcl\" (UID: \"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7\") " pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysctl-conf\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-node-log\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqv8x\" (UniqueName: \"kubernetes.io/projected/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-kube-api-access-jqv8x\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814252    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-system-cni-dir\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.814267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-cnibin\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-kubelet\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8bs\" (UniqueName: \"kubernetes.io/projected/c2460bf3-2c5d-43aa-b837-c64534bdd617-kube-api-access-rq8bs\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-registration-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-modprobe-d\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-systemd\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-run-netns\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-serviceca\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-cni-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovn-node-metrics-cert\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2c533d-fbe9-4774-92b8-433683baafb5-tmp-dir\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d151e286-652c-404f-aa1d-f1fded98484a-multus-daemon-config\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysconfig\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.814641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-var-lib-kubelet\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-var-lib-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovnkube-config\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovnkube-script-lib\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67c3f51b-c2de-41c4-a2ff-0943d1e75372-kubelet-config\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-cni-multus\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmzrb\" (UniqueName: \"kubernetes.io/projected/71915ca2-dbb9-4481-b041-95b84a43080f-kube-api-access-mmzrb\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-cni-bin\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgsxb\" (UniqueName: \"kubernetes.io/projected/ed2c533d-fbe9-4774-92b8-433683baafb5-kube-api-access-qgsxb\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-kubernetes\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78176b7d-5f23-4223-be12-07188e181cce-etc-tuned\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78176b7d-5f23-4223-be12-07188e181cce-tmp\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-log-socket\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-socket-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-run\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.815343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.814987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67c3f51b-c2de-41c4-a2ff-0943d1e75372-dbus\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-host\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cnibin\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d151e286-652c-404f-aa1d-f1fded98484a-cni-binary-copy\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2460bf3-2c5d-43aa-b837-c64534bdd617-iptables-alerter-script\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2460bf3-2c5d-43aa-b837-c64534bdd617-host-slash\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-etc-selinux\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-host\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-cni-bin\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-hostroot\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-conf-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs4d5\" (UniqueName: \"kubernetes.io/projected/78176b7d-5f23-4223-be12-07188e181cce-kube-api-access-bs4d5\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-multus-certs\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-env-overrides\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.816017 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-system-cni-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-socket-dir-parent\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5br\" (UniqueName: \"kubernetes.io/projected/d151e286-652c-404f-aa1d-f1fded98484a-kube-api-access-7v5br\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysctl-d\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-slash\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed2c533d-fbe9-4774-92b8-433683baafb5-hosts-file\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-k8s-cni-cncf-io\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-kubelet\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-etc-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wgvq\" (UniqueName: \"kubernetes.io/projected/aa26e9b6-44e6-4e96-8310-2b3d4995b415-kube-api-access-6wgvq\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-os-release\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqvb2\" (UniqueName: \"kubernetes.io/projected/fc26931b-f9cb-4077-9c00-a41a3354a4e3-kube-api-access-pqvb2\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.816478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.815846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-etc-kubernetes\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.916810 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.916893 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-slash\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.916893 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed2c533d-fbe9-4774-92b8-433683baafb5-hosts-file\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.916893 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-k8s-cni-cncf-io\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.916893 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-kubelet\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-etc-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-slash\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed2c533d-fbe9-4774-92b8-433683baafb5-hosts-file\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-k8s-cni-cncf-io\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-kubelet\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-etc-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.916932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wgvq\" (UniqueName: \"kubernetes.io/projected/aa26e9b6-44e6-4e96-8310-2b3d4995b415-kube-api-access-6wgvq\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-os-release\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.917056 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvb2\" (UniqueName: \"kubernetes.io/projected/fc26931b-f9cb-4077-9c00-a41a3354a4e3-kube-api-access-pqvb2\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-etc-kubernetes\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-device-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-sys\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-os-release\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-etc-kubernetes\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-device-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-sys\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-os-release\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.917244    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-netns\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917255    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-systemd-units\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-os-release\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-netns\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.917522 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-systemd-units\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.917331    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:48.41729165 +0000 UTC m=+2.061554683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24cec716-6bc2-4ba8-b6c9-0d7ab89baff7-agent-certs\") pod \"konnectivity-agent-htbcl\" (UID: \"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7\") " pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-sys-fs\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-lib-modules\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lwr\" (UniqueName: \"kubernetes.io/projected/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-kube-api-access-r7lwr\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-sys-fs\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-systemd\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-systemd\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-lib-modules\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-ovn\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-cni-netd\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24cec716-6bc2-4ba8-b6c9-0d7ab89baff7-konnectivity-ca\") pod \"konnectivity-agent-htbcl\" (UID: \"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7\") " pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917749    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-cni-netd\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-ovn\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysctl-conf\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.918392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-node-log\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysctl-conf\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqv8x\" (UniqueName: \"kubernetes.io/projected/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-kube-api-access-jqv8x\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-node-log\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-system-cni-dir\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-cnibin\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-system-cni-dir\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-kubelet\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-kubelet\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8bs\" (UniqueName: \"kubernetes.io/projected/c2460bf3-2c5d-43aa-b837-c64534bdd617-kube-api-access-rq8bs\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-cnibin\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.917989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-registration-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-modprobe-d\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-systemd\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-run-netns\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.919204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-registration-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-modprobe-d\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-serviceca\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-run-netns\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-systemd\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-cni-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-run-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovn-node-metrics-cert\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/24cec716-6bc2-4ba8-b6c9-0d7ab89baff7-konnectivity-ca\") pod \"konnectivity-agent-htbcl\" (UID: \"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7\") " pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2c533d-fbe9-4774-92b8-433683baafb5-tmp-dir\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-cni-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d151e286-652c-404f-aa1d-f1fded98484a-multus-daemon-config\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-serviceca\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysconfig\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-var-lib-kubelet\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysconfig\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-var-lib-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-var-lib-openvswitch\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovnkube-config\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovnkube-script-lib\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-var-lib-kubelet\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2c533d-fbe9-4774-92b8-433683baafb5-tmp-dir\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67c3f51b-c2de-41c4-a2ff-0943d1e75372-kubelet-config\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-cni-multus\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmzrb\" (UniqueName: \"kubernetes.io/projected/71915ca2-dbb9-4481-b041-95b84a43080f-kube-api-access-mmzrb\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-cni-bin\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgsxb\" (UniqueName: \"kubernetes.io/projected/ed2c533d-fbe9-4774-92b8-433683baafb5-kube-api-access-qgsxb\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-kubernetes\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78176b7d-5f23-4223-be12-07188e181cce-etc-tuned\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78176b7d-5f23-4223-be12-07188e181cce-tmp\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.920950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-log-socket\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-socket-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-run\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.918993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67c3f51b-c2de-41c4-a2ff-0943d1e75372-dbus\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-host\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cnibin\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d151e286-652c-404f-aa1d-f1fded98484a-cni-binary-copy\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2460bf3-2c5d-43aa-b837-c64534bdd617-iptables-alerter-script\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2460bf3-2c5d-43aa-b837-c64534bdd617-host-slash\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-etc-selinux\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-host\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-cni-bin\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-hostroot\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-conf-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovnkube-script-lib\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs4d5\" (UniqueName: \"kubernetes.io/projected/78176b7d-5f23-4223-be12-07188e181cce-kube-api-access-bs4d5\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovnkube-config\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.921840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cnibin\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67c3f51b-c2de-41c4-a2ff-0943d1e75372-kubelet-config\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-multus-certs\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-cni-binary-copy\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-host\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-env-overrides\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-system-cni-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-cni-multus\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-kubernetes\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-host-cni-bin\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919759    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d151e286-652c-404f-aa1d-f1fded98484a-cni-binary-copy\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa26e9b6-44e6-4e96-8310-2b3d4995b415-env-overrides\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-var-lib-cni-bin\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-hostroot\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-socket-dir-parent\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-conf-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67c3f51b-c2de-41c4-a2ff-0943d1e75372-dbus\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-socket-dir\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-run\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa26e9b6-44e6-4e96-8310-2b3d4995b415-log-socket\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920254    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2460bf3-2c5d-43aa-b837-c64534bdd617-host-slash\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71915ca2-dbb9-4481-b041-95b84a43080f-etc-selinux\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-system-cni-dir\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-host-run-multus-certs\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.919487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d151e286-652c-404f-aa1d-f1fded98484a-multus-socket-dir-parent\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5br\" (UniqueName: \"kubernetes.io/projected/d151e286-652c-404f-aa1d-f1fded98484a-kube-api-access-7v5br\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysctl-d\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d151e286-652c-404f-aa1d-f1fded98484a-multus-daemon-config\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78176b7d-5f23-4223-be12-07188e181cce-etc-sysctl-d\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.920765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-host\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.920835    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.920886    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:48.420867089 +0000 UTC m=+2.065130121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:47.922881 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.921272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa26e9b6-44e6-4e96-8310-2b3d4995b415-ovn-node-metrics-cert\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.923331 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.921407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/24cec716-6bc2-4ba8-b6c9-0d7ab89baff7-agent-certs\") pod \"konnectivity-agent-htbcl\" (UID: \"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7\") " pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:47.923331 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.922033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78176b7d-5f23-4223-be12-07188e181cce-tmp\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.923331 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.922163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78176b7d-5f23-4223-be12-07188e181cce-etc-tuned\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.924816 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.924796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc26931b-f9cb-4077-9c00-a41a3354a4e3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.924816 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.924804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2460bf3-2c5d-43aa-b837-c64534bdd617-iptables-alerter-script\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.926861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.926790    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wgvq\" (UniqueName: \"kubernetes.io/projected/aa26e9b6-44e6-4e96-8310-2b3d4995b415-kube-api-access-6wgvq\") pod \"ovnkube-node-pgjmb\" (UID: \"aa26e9b6-44e6-4e96-8310-2b3d4995b415\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:47.926983 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.926880    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:47.926983 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.926899    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:47.926983 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.926913    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:47.927145 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:47.927022    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:48.427005268 +0000 UTC m=+2.071268299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:47.927703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.927679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqv8x\" (UniqueName: \"kubernetes.io/projected/e329faa8-ddf2-4620-85d3-7288e5dcb8d2-kube-api-access-jqv8x\") pod \"node-ca-f55bq\" (UID: \"e329faa8-ddf2-4620-85d3-7288e5dcb8d2\") " pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:47.928582 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.928563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8bs\" (UniqueName: \"kubernetes.io/projected/c2460bf3-2c5d-43aa-b837-c64534bdd617-kube-api-access-rq8bs\") pod \"iptables-alerter-qcg29\" (UID: \"c2460bf3-2c5d-43aa-b837-c64534bdd617\") " pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:47.928670 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.928567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lwr\" (UniqueName: \"kubernetes.io/projected/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-kube-api-access-r7lwr\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:47.928670 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.928644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqvb2\" (UniqueName: \"kubernetes.io/projected/fc26931b-f9cb-4077-9c00-a41a3354a4e3-kube-api-access-pqvb2\") pod \"multus-additional-cni-plugins-rfrf7\" (UID: \"fc26931b-f9cb-4077-9c00-a41a3354a4e3\") " pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:47.928756 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.928673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmzrb\" (UniqueName: \"kubernetes.io/projected/71915ca2-dbb9-4481-b041-95b84a43080f-kube-api-access-mmzrb\") pod \"aws-ebs-csi-driver-node-w6wzn\" (UID: \"71915ca2-dbb9-4481-b041-95b84a43080f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:47.928888 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.928872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgsxb\" (UniqueName: \"kubernetes.io/projected/ed2c533d-fbe9-4774-92b8-433683baafb5-kube-api-access-qgsxb\") pod \"node-resolver-9km98\" (UID: \"ed2c533d-fbe9-4774-92b8-433683baafb5\") " pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:47.929091 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.929071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs4d5\" (UniqueName: \"kubernetes.io/projected/78176b7d-5f23-4223-be12-07188e181cce-kube-api-access-bs4d5\") pod \"tuned-bqtjj\" (UID: \"78176b7d-5f23-4223-be12-07188e181cce\") " pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:47.929436 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.929421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5br\" (UniqueName: \"kubernetes.io/projected/d151e286-652c-404f-aa1d-f1fded98484a-kube-api-access-7v5br\") pod \"multus-dt7lg\" (UID: \"d151e286-652c-404f-aa1d-f1fded98484a\") " pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:47.934511 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:47.934482    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f041e38e0008b1154b43505cb789167.slice/crio-670aeaa077e44adfd1f0ddcd8284891a3026290f69d54a3e543604e1f2252ab3 WatchSource:0}: Error finding container 670aeaa077e44adfd1f0ddcd8284891a3026290f69d54a3e543604e1f2252ab3: Status 404 returned error can't find the container with id 670aeaa077e44adfd1f0ddcd8284891a3026290f69d54a3e543604e1f2252ab3
Jul 24 19:34:47.935003 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:47.934985    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6170be9fef07e697dd1374e418f97f1.slice/crio-c7234bcd370b8fa6a4b83cb551e98926853aeb796e4fa3c114195fb130a97e90 WatchSource:0}: Error finding container c7234bcd370b8fa6a4b83cb551e98926853aeb796e4fa3c114195fb130a97e90: Status 404 returned error can't find the container with id c7234bcd370b8fa6a4b83cb551e98926853aeb796e4fa3c114195fb130a97e90
Jul 24 19:34:47.938736 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:47.938723    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:34:48.006667 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.006627    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:48.039666 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.039638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9km98"
Jul 24 19:34:48.048496 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.048477    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2c533d_fbe9_4774_92b8_433683baafb5.slice/crio-4cea5805de8c6f7ac8ca34b13e29d1e64862fbb3b251cb81fbcb71f962a19ea5 WatchSource:0}: Error finding container 4cea5805de8c6f7ac8ca34b13e29d1e64862fbb3b251cb81fbcb71f962a19ea5: Status 404 returned error can't find the container with id 4cea5805de8c6f7ac8ca34b13e29d1e64862fbb3b251cb81fbcb71f962a19ea5
Jul 24 19:34:48.058944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.058927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn"
Jul 24 19:34:48.067667 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.067650    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71915ca2_dbb9_4481_b041_95b84a43080f.slice/crio-6d68de11477b39724a2724b254d3af9e04f0b4470e83711b372b59b815884bb1 WatchSource:0}: Error finding container 6d68de11477b39724a2724b254d3af9e04f0b4470e83711b372b59b815884bb1: Status 404 returned error can't find the container with id 6d68de11477b39724a2724b254d3af9e04f0b4470e83711b372b59b815884bb1
Jul 24 19:34:48.075525 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.075510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:34:48.082487 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.082453    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cec716_6bc2_4ba8_b6c9_0d7ab89baff7.slice/crio-0c43fbe2c050648157e6f9f9ed98a8d67c9363360ad7cd3d03897d44bceeba02 WatchSource:0}: Error finding container 0c43fbe2c050648157e6f9f9ed98a8d67c9363360ad7cd3d03897d44bceeba02: Status 404 returned error can't find the container with id 0c43fbe2c050648157e6f9f9ed98a8d67c9363360ad7cd3d03897d44bceeba02
Jul 24 19:34:48.087156 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.087140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f55bq"
Jul 24 19:34:48.091979 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.091957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqtjj"
Jul 24 19:34:48.094343 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.094327    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode329faa8_ddf2_4620_85d3_7288e5dcb8d2.slice/crio-743f78907d9fff77bf1f12179eb5fa0cffbebca8ae1dd30597fc23b514a71d42 WatchSource:0}: Error finding container 743f78907d9fff77bf1f12179eb5fa0cffbebca8ae1dd30597fc23b514a71d42: Status 404 returned error can't find the container with id 743f78907d9fff77bf1f12179eb5fa0cffbebca8ae1dd30597fc23b514a71d42
Jul 24 19:34:48.099508 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.099491    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78176b7d_5f23_4223_be12_07188e181cce.slice/crio-3f02137a1f80a2c464fc618676ae66c700dc2897fa04cf82ca639875958e879e WatchSource:0}: Error finding container 3f02137a1f80a2c464fc618676ae66c700dc2897fa04cf82ca639875958e879e: Status 404 returned error can't find the container with id 3f02137a1f80a2c464fc618676ae66c700dc2897fa04cf82ca639875958e879e
Jul 24 19:34:48.107395 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.107379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rfrf7"
Jul 24 19:34:48.115906 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.115887    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc26931b_f9cb_4077_9c00_a41a3354a4e3.slice/crio-b3c0e4427d4d158562afcdebea953562f7f80343dedd792af0e145d5407b6bdf WatchSource:0}: Error finding container b3c0e4427d4d158562afcdebea953562f7f80343dedd792af0e145d5407b6bdf: Status 404 returned error can't find the container with id b3c0e4427d4d158562afcdebea953562f7f80343dedd792af0e145d5407b6bdf
Jul 24 19:34:48.125376 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.125360    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:34:48.132514 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.132497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa26e9b6_44e6_4e96_8310_2b3d4995b415.slice/crio-4078f019f39cf9b2fe9ad2e67e3ea9a2fd718c8cdcc5690ee18bc83118761a0b WatchSource:0}: Error finding container 4078f019f39cf9b2fe9ad2e67e3ea9a2fd718c8cdcc5690ee18bc83118761a0b: Status 404 returned error can't find the container with id 4078f019f39cf9b2fe9ad2e67e3ea9a2fd718c8cdcc5690ee18bc83118761a0b
Jul 24 19:34:48.141978 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.141963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dt7lg"
Jul 24 19:34:48.146786 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.146771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qcg29"
Jul 24 19:34:48.150574 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.150558    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd151e286_652c_404f_aa1d_f1fded98484a.slice/crio-0340cd67e314a22351144dafa7117d741d00585a90e4870865d130e18bf770f9 WatchSource:0}: Error finding container 0340cd67e314a22351144dafa7117d741d00585a90e4870865d130e18bf770f9: Status 404 returned error can't find the container with id 0340cd67e314a22351144dafa7117d741d00585a90e4870865d130e18bf770f9
Jul 24 19:34:48.155093 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:34:48.155074    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2460bf3_2c5d_43aa_b837_c64534bdd617.slice/crio-71fc307f75f88d5fb3bbba7588a4795ea40226a81d45d54ffcdd3db1fd3fec68 WatchSource:0}: Error finding container 71fc307f75f88d5fb3bbba7588a4795ea40226a81d45d54ffcdd3db1fd3fec68: Status 404 returned error can't find the container with id 71fc307f75f88d5fb3bbba7588a4795ea40226a81d45d54ffcdd3db1fd3fec68
Jul 24 19:34:48.425905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.425800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:48.425905 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.425861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:48.426095 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.425998    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:48.426095 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.426001    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:48.426095 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.426059    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:49.426040795 +0000 UTC m=+3.070303814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:48.426095 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.426081    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:49.42606961 +0000 UTC m=+3.070332642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:48.526215 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.526182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:48.526394 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.526378    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:48.526466 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.526401    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:48.526466 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.526429    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:48.526621 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:48.526499    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:49.526480808 +0000 UTC m=+3.170743839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:48.754976 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.754888    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:29:47 +0000 UTC" deadline="2028-02-13 03:26:36.972966502 +0000 UTC"
Jul 24 19:34:48.754976 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.754930    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13639h51m48.218041273s"
Jul 24 19:34:48.866715 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.866648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"4078f019f39cf9b2fe9ad2e67e3ea9a2fd718c8cdcc5690ee18bc83118761a0b"}
Jul 24 19:34:48.888366 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.888332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f55bq" event={"ID":"e329faa8-ddf2-4620-85d3-7288e5dcb8d2","Type":"ContainerStarted","Data":"743f78907d9fff77bf1f12179eb5fa0cffbebca8ae1dd30597fc23b514a71d42"}
Jul 24 19:34:48.906751 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.906690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-htbcl" event={"ID":"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7","Type":"ContainerStarted","Data":"0c43fbe2c050648157e6f9f9ed98a8d67c9363360ad7cd3d03897d44bceeba02"}
Jul 24 19:34:48.915778 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.915705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" event={"ID":"0f041e38e0008b1154b43505cb789167","Type":"ContainerStarted","Data":"670aeaa077e44adfd1f0ddcd8284891a3026290f69d54a3e543604e1f2252ab3"}
Jul 24 19:34:48.938343 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.938296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qcg29" event={"ID":"c2460bf3-2c5d-43aa-b837-c64534bdd617","Type":"ContainerStarted","Data":"71fc307f75f88d5fb3bbba7588a4795ea40226a81d45d54ffcdd3db1fd3fec68"}
Jul 24 19:34:48.957865 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.957779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerStarted","Data":"b3c0e4427d4d158562afcdebea953562f7f80343dedd792af0e145d5407b6bdf"}
Jul 24 19:34:48.963338 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.963309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqtjj" event={"ID":"78176b7d-5f23-4223-be12-07188e181cce","Type":"ContainerStarted","Data":"3f02137a1f80a2c464fc618676ae66c700dc2897fa04cf82ca639875958e879e"}
Jul 24 19:34:48.989145 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:48.989011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn" event={"ID":"71915ca2-dbb9-4481-b041-95b84a43080f","Type":"ContainerStarted","Data":"6d68de11477b39724a2724b254d3af9e04f0b4470e83711b372b59b815884bb1"}
Jul 24 19:34:49.015538 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.015313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9km98" event={"ID":"ed2c533d-fbe9-4774-92b8-433683baafb5","Type":"ContainerStarted","Data":"4cea5805de8c6f7ac8ca34b13e29d1e64862fbb3b251cb81fbcb71f962a19ea5"}
Jul 24 19:34:49.017997 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.017977    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:49.029040 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.029002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" event={"ID":"d6170be9fef07e697dd1374e418f97f1","Type":"ContainerStarted","Data":"c7234bcd370b8fa6a4b83cb551e98926853aeb796e4fa3c114195fb130a97e90"}
Jul 24 19:34:49.048896 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.048867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dt7lg" event={"ID":"d151e286-652c-404f-aa1d-f1fded98484a","Type":"ContainerStarted","Data":"0340cd67e314a22351144dafa7117d741d00585a90e4870865d130e18bf770f9"}
Jul 24 19:34:49.266154 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.266070    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 19:34:49.433961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.433687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:49.433961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.433762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:49.433961 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.433825    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:49.433961 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.433885    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:49.433961 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.433901    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:51.433882253 +0000 UTC m=+5.078145274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:49.433961 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.433935    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:51.433918408 +0000 UTC m=+5.078181433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:49.534762 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.534090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:49.534762 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.534254    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:49.534762 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.534272    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:49.534762 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.534284    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:49.534762 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.534339    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:51.534321868 +0000 UTC m=+5.178584893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:49.755469 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.755395    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 19:29:47 +0000 UTC" deadline="2028-04-25 21:54:00.940120594 +0000 UTC"
Jul 24 19:34:49.755469 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.755467    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15386h19m11.184669787s"
Jul 24 19:34:49.836783 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.836709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:49.836913 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.836845    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:34:49.837079 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.837056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:49.837189 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.837170    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:49.837259 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:49.837241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:49.837343 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:49.837324    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:51.451826 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:51.451791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:51.452326 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:51.451856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:51.452326 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.451959    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:51.452326 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.451985    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:51.452326 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.452043    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:55.452023667 +0000 UTC m=+9.096286686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:51.452326 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.452064    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:55.45205342 +0000 UTC m=+9.096316445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:51.552340 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:51.552260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:51.552643 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.552470    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:51.552643 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.552495    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:51.552643 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.552509    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:51.552643 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.552571    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:34:55.552553131 +0000 UTC m=+9.196816153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:51.836849 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:51.836778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:51.836998 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:51.836892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:51.836998 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.836903    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:34:51.836998 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.836974    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:51.837205 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:51.837011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:51.837205 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:51.837083    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:53.836974 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:53.836936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:53.837402 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:53.836977    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:53.837402 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:53.837089    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:53.837402 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:53.837195    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:53.837402 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:53.837257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:53.837402 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:53.837335    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:34:55.486041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:55.485968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:55.486041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:55.486043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:55.486548 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.486172    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:55.486548 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.486239    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:03.486220278 +0000 UTC m=+17.130483313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:34:55.486735 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.486667    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:55.486735 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.486732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:03.486715353 +0000 UTC m=+17.130978376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:34:55.587076 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:55.586978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:55.587254 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.587166    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:34:55.587254 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.587191    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:34:55.587254 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.587206    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:55.587410 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.587279    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:03.587256779 +0000 UTC m=+17.231519800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:34:55.837008 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:55.836490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:55.837008 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.836612    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:55.837008 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:55.836690    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:55.837008 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.836790    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:55.837008 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:55.836816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:55.837008 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:55.836878    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:34:57.836561 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:57.836443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:57.836979 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:57.836577    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:57.836979 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:57.836591    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:57.836979 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:57.836607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:57.836979 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:57.836697    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:57.836979 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:57.836777    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:34:59.837420 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:59.837383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:34:59.837908 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:59.837436    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:34:59.837908 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:34:59.837436    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:34:59.837908 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:59.837520    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:34:59.837908 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:59.837646    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:34:59.837908 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:34:59.837750    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:01.836793 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:01.836755    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:01.837222 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:01.836758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:01.837222 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:01.836862    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:01.837222 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:01.836767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:01.837222 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:01.836964    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:01.837222 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:01.837056    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:03.548380 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:03.548340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:03.548824 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:03.548405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:03.548824 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.548529    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:35:03.548824 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.548558    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:35:03.548824 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.548609    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:19.54858613 +0000 UTC m=+33.192849152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:35:03.548824 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.548630    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:19.54861863 +0000 UTC m=+33.192881650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:35:03.649440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:03.649410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:03.649622 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.649550    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:35:03.649622 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.649566    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:35:03.649622 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.649575    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:35:03.649622 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.649620    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:19.649606751 +0000 UTC m=+33.293869769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:35:03.836918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:03.836847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:03.837083 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:03.836847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:03.837083 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.836968    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:03.837083 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:03.836847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:03.837083 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.837042    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:03.837285 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:03.837127    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:05.837433 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:05.837233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:05.837913 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:05.837282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:05.837913 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:05.837526    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:05.837913 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:05.837287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:05.837913 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:05.837580    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:05.837913 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:05.837696    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:07.836753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:07.836602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:07.837257 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:07.836647    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:07.837257 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:07.836824    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:07.837257 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:07.836659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:07.837257 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:07.836897    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:07.837257 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:07.836974    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:08.095929 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.095501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-htbcl" event={"ID":"24cec716-6bc2-4ba8-b6c9-0d7ab89baff7","Type":"ContainerStarted","Data":"db78ec09a33ed0ab753f1d494c338b5630451713b9b3e1816cf1bb1ff8ba3e04"}
Jul 24 19:35:08.097261 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.097234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" event={"ID":"0f041e38e0008b1154b43505cb789167","Type":"ContainerStarted","Data":"b4c71b0911350af335274fa4049559c06a6874acc77e1584955bd6563dca2246"}
Jul 24 19:35:08.099197 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.099173    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc26931b-f9cb-4077-9c00-a41a3354a4e3" containerID="f1c074c415b4ad79aa56040580920e2b669274fd446359d0afec43cf59f7c6b4" exitCode=0
Jul 24 19:35:08.099310 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.099246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerDied","Data":"f1c074c415b4ad79aa56040580920e2b669274fd446359d0afec43cf59f7c6b4"}
Jul 24 19:35:08.101514 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.101493    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqtjj" event={"ID":"78176b7d-5f23-4223-be12-07188e181cce","Type":"ContainerStarted","Data":"0641cb02cf67130f504db66742737f847711fae3d99bc6758ff6062ee1e240e7"}
Jul 24 19:35:08.103223 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.103198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn" event={"ID":"71915ca2-dbb9-4481-b041-95b84a43080f","Type":"ContainerStarted","Data":"fd48833484c2e7c5202c6d8d8ba0f66204c3c3e75447b51048074b87a41c18e7"}
Jul 24 19:35:08.105065 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.105035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9km98" event={"ID":"ed2c533d-fbe9-4774-92b8-433683baafb5","Type":"ContainerStarted","Data":"e516ce7f7d1eb91f16fae7c033df87c2bc1b685399d05797663b9dfc84d266fc"}
Jul 24 19:35:08.106861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.106838    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6170be9fef07e697dd1374e418f97f1" containerID="3d4d73399349eb28e51ebe2b33258d0af70793918610ad6a0e9bd26bcc00cf7b" exitCode=0
Jul 24 19:35:08.106977 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.106943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" event={"ID":"d6170be9fef07e697dd1374e418f97f1","Type":"ContainerDied","Data":"3d4d73399349eb28e51ebe2b33258d0af70793918610ad6a0e9bd26bcc00cf7b"}
Jul 24 19:35:08.108696 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.108645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dt7lg" event={"ID":"d151e286-652c-404f-aa1d-f1fded98484a","Type":"ContainerStarted","Data":"8f6a7769f1f00dec1f6495d9f3451b719332d68216c236c34b619ac084de945e"}
Jul 24 19:35:08.110046 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.110001    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-htbcl" podStartSLOduration=3.284160989 podStartE2EDuration="22.109986269s" totalImagesPullingTime="18.82582528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:08.109985257 +0000 UTC m=+21.754248298" watchObservedRunningTime="2026-07-24 19:35:08.109986269 +0000 UTC m=+21.754249311"
Jul 24 19:35:08.112365 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.112330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"eee6b63c1b1b358eaad8a64f6e676ce5d71fbc8a7b5d83bab180e94e4f93c9e0"}
Jul 24 19:35:08.112492 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.112415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"2cc8275592769306e4ad10215473b89ccd8a78c69916c2a8bae6859431a67e34"}
Jul 24 19:35:08.112492 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.112447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"43f1e2a0a4b0058b8443e390cf1949a2ce7b16da07d23c5600f1c6226e415142"}
Jul 24 19:35:08.112584 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.112546    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"ec76d9fd0032d95fb21503c98f22451d80a0d479d556ccdd741400bd516cb4f9"}
Jul 24 19:35:08.112618 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.112593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"3efbf49afe82cf1ef2546cceb35b76915970422048a80c2377573fd65b2e4189"}
Jul 24 19:35:08.112656 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.112637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"059c0f318088bf0108d79f44e0401dc34bfc6cada635e2b6c55cf3e29b832251"}
Jul 24 19:35:08.114028 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.113997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f55bq" event={"ID":"e329faa8-ddf2-4620-85d3-7288e5dcb8d2","Type":"ContainerStarted","Data":"90abf04f401375da634702c507a6a0d45b52df0af00bf64ff38684b5d8639bb7"}
Jul 24 19:35:08.137393 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.137347    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" podStartSLOduration=21.137329714 podStartE2EDuration="21.137329714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:08.1371782 +0000 UTC m=+21.781441242" watchObservedRunningTime="2026-07-24 19:35:08.137329714 +0000 UTC m=+21.781592755"
Jul 24 19:35:08.152052 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.152011    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9km98" podStartSLOduration=3.2921389 podStartE2EDuration="22.151993855s" totalImagesPullingTime="18.859854955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:08.150995033 +0000 UTC m=+21.795258074" watchObservedRunningTime="2026-07-24 19:35:08.151993855 +0000 UTC m=+21.796256896"
Jul 24 19:35:08.189330 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.189292    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bqtjj" podStartSLOduration=3.359950692 podStartE2EDuration="22.189280239s" totalImagesPullingTime="18.829329547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:08.189265399 +0000 UTC m=+21.833528438" watchObservedRunningTime="2026-07-24 19:35:08.189280239 +0000 UTC m=+21.833543278"
Jul 24 19:35:08.208387 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.208354    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dt7lg" podStartSLOduration=3.414851151 podStartE2EDuration="22.208342381s" totalImagesPullingTime="18.79349123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:08.207857797 +0000 UTC m=+21.852120837" watchObservedRunningTime="2026-07-24 19:35:08.208342381 +0000 UTC m=+21.852605422"
Jul 24 19:35:08.221827 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.221797    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f55bq" podStartSLOduration=3.409131479 podStartE2EDuration="22.22178839s" totalImagesPullingTime="18.812656911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:08.221646945 +0000 UTC m=+21.865909986" watchObservedRunningTime="2026-07-24 19:35:08.22178839 +0000 UTC m=+21.866051429"
Jul 24 19:35:08.278239 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.278207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:08.359394 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.359362    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:08.762086 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.762062    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 19:35:08.779001 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.778921    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T19:35:08.762082066Z","UUID":"09c6b53f-6f6e-41d0-9a36-9b9f82771a4f","Handler":null,"Name":"","Endpoint":""}
Jul 24 19:35:08.780245 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.780226    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 19:35:08.780344 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.780261    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 19:35:08.824550 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.824525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:08.840503 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.840484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:35:08.841015 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.840996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:35:08.872037 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:08.872007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:09.120397 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.120322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qcg29" event={"ID":"c2460bf3-2c5d-43aa-b837-c64534bdd617","Type":"ContainerStarted","Data":"7787a1eab28166467a2f8ada654a62057aea36fb25b17669985825845f4f3364"}
Jul 24 19:35:09.123419 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.123387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn" event={"ID":"71915ca2-dbb9-4481-b041-95b84a43080f","Type":"ContainerStarted","Data":"be61c7baf13065e4cd56b38a383b0b9e9f1e1472d2cc980110c3b9d16cfc0f26"}
Jul 24 19:35:09.125861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.125815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" event={"ID":"d6170be9fef07e697dd1374e418f97f1","Type":"ContainerStarted","Data":"a81aa3194e57fc29c265cbfc30c74932991db8a8a2d9913efaf37f9078b45f93"}
Jul 24 19:35:09.126948 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.126825    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:35:09.127382 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.127364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-htbcl"
Jul 24 19:35:09.135989 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.135949    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qcg29" podStartSLOduration=4.358871259 podStartE2EDuration="23.135936387s" totalImagesPullingTime="18.777065128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:09.135637838 +0000 UTC m=+22.779900878" watchObservedRunningTime="2026-07-24 19:35:09.135936387 +0000 UTC m=+22.780199426"
Jul 24 19:35:09.165223 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.165178    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" podStartSLOduration=22.165160287 podStartE2EDuration="22.165160287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:09.164685871 +0000 UTC m=+22.808948924" watchObservedRunningTime="2026-07-24 19:35:09.165160287 +0000 UTC m=+22.809423328"
Jul 24 19:35:09.200827 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.200791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:09.302070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.302044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:09.836841 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.836819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:09.836991 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.836852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:09.836991 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.836822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:09.836991 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:09.836949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:09.837123 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:09.837041    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:09.837169 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:09.837134    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:09.947645 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:09.947620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:10.049936 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:10.049908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:10.130691 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:10.130664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn" event={"ID":"71915ca2-dbb9-4481-b041-95b84a43080f","Type":"ContainerStarted","Data":"a2a5629043b5a662f84694b824e6c81f20b74d13900ab2574ecc7d0f194f6d94"}
Jul 24 19:35:10.148379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:10.148340    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w6wzn" podStartSLOduration=3.206183757 podStartE2EDuration="24.14832385s" totalImagesPullingTime="20.942140093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:10.147719197 +0000 UTC m=+23.791982237" watchObservedRunningTime="2026-07-24 19:35:10.14832385 +0000 UTC m=+23.792586890"
Jul 24 19:35:10.155839 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:10.155813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:10.424728 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:10.424650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:10.525518 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:10.525486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:11.136679 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:11.136640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"7f1027fa8dfafe5349f83867aad85466c39460c9ad6d074ce021be4db3f08b19"}
Jul 24 19:35:11.837301 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:11.837271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:11.837301 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:11.837289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:11.837556 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:11.837378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:11.837556 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:11.837389    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:11.837556 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:11.837434    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:11.837556 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:11.837525    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:11.908662 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:11.908626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:11.976063 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:11.976020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:12.156067 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:12.156001    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:12.209617 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:12.209588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:12.818986 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:12.818755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:12.885123 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:12.885098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:12.940390 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:12.940373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:13.129689 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.129623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:13.144470 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.144432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" event={"ID":"aa26e9b6-44e6-4e96-8310-2b3d4995b415","Type":"ContainerStarted","Data":"4880c905e7fb11f8dc15a5dc0a7f3793876cc87605750d56e01c03b186694ac1"}
Jul 24 19:35:13.144768 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.144662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:35:13.144768 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.144721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:35:13.146325 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.146297    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc26931b-f9cb-4077-9c00-a41a3354a4e3" containerID="258edbdc8d6805d9bda87726f8e3d30141d6b4f92abb8a9ff9949d18bfc78a75" exitCode=0
Jul 24 19:35:13.146423 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.146335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerDied","Data":"258edbdc8d6805d9bda87726f8e3d30141d6b4f92abb8a9ff9949d18bfc78a75"}
Jul 24 19:35:13.159693 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.159677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:35:13.171400 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.171365    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb" podStartSLOduration=7.9485355 podStartE2EDuration="27.17135427s" totalImagesPullingTime="19.22281877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:13.169809194 +0000 UTC m=+26.814072234" watchObservedRunningTime="2026-07-24 19:35:13.17135427 +0000 UTC m=+26.815617310"
Jul 24 19:35:13.191537 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.191518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:13.567493 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.567356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:13.668068 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.668033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:13.836622 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.836549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:13.836622 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.836549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:13.836838 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.836549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:13.836838 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:13.836672    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:13.836838 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:13.836765    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:13.836988 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:13.836849    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:13.837192 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.837167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:13.920784 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.920758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9km98_ed2c533d-fbe9-4774-92b8-433683baafb5/dns-node-resolver/0.log"
Jul 24 19:35:13.939422 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:13.939394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:14.038269 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.038121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:14.150973 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.150943    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc26931b-f9cb-4077-9c00-a41a3354a4e3" containerID="69e8c11f083313a02d28860d1e1238890e917fc5e1af0e66f481fbd2424a49f5" exitCode=0
Jul 24 19:35:14.151104 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.150989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerDied","Data":"69e8c11f083313a02d28860d1e1238890e917fc5e1af0e66f481fbd2424a49f5"}
Jul 24 19:35:14.151500 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.151434    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:35:14.165202 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.165186    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:35:14.521180 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.521125    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f55bq_e329faa8-ddf2-4620-85d3-7288e5dcb8d2/node-ca/0.log"
Jul 24 19:35:14.524611 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.524589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nwdnf"]
Jul 24 19:35:14.524712 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.524674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:14.524771 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:14.524755    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:14.527717 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.527690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j464j"]
Jul 24 19:35:14.527803 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.527768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:14.527865 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:14.527847    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:14.539346 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.539316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8vms"]
Jul 24 19:35:14.539489 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:14.539447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:14.539587 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:14.539570    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:15.026377 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.026348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:15.126021 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.126000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:15.155031 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.155005    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc26931b-f9cb-4077-9c00-a41a3354a4e3" containerID="1cd6924f9ab2d778a4e9838877c7fd5dffca96d444ad261219945fb7977c9e8d" exitCode=0
Jul 24 19:35:15.155165 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.155091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerDied","Data":"1cd6924f9ab2d778a4e9838877c7fd5dffca96d444ad261219945fb7977c9e8d"}
Jul 24 19:35:15.471742 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.471669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:15.520087 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.520059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:15.837005 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.836936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:15.837245 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:15.837064    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:15.837245 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:15.837111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:15.837332 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:15.837236    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:16.293573 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:16.293492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:16.838121 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:16.838093    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:16.838590 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:16.838179    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:17.837326 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:17.837294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:17.837326 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:17.837313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:17.837561 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:17.837410    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:17.837627 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:17.837568    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:18.837184 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:18.837153    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:18.837643 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:18.837279    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:19.221123 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.221055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:19.571307 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.571277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:19.571448 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.571426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:19.571534 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.571428    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:35:19.571534 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.571503    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 19:35:19.571635 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.571540    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs podName:8ab1f5c3-d764-4742-8d9e-af785ea7e1d3 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:51.571519832 +0000 UTC m=+65.215782858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs") pod "network-metrics-daemon-d8vms" (UID: "8ab1f5c3-d764-4742-8d9e-af785ea7e1d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 19:35:19.571635 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.571559    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret podName:67c3f51b-c2de-41c4-a2ff-0943d1e75372 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:51.571548539 +0000 UTC m=+65.215811557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret") pod "global-pull-secret-syncer-j464j" (UID: "67c3f51b-c2de-41c4-a2ff-0943d1e75372") : object "kube-system"/"original-pull-secret" not registered
Jul 24 19:35:19.671886 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.671726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:19.671886 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.671884    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 19:35:19.672034 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.671901    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 19:35:19.672034 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.671911    2560 projected.go:196] Error preparing data for projected volume kube-api-access-rn7cj for pod openshift-network-diagnostics/network-check-target-nwdnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:35:19.672034 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.671955    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj podName:c4f30495-8f9d-433a-9e5d-da96145ab5f9 nodeName:}" failed. No retries permitted until 2026-07-24 19:35:51.671942162 +0000 UTC m=+65.316205180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rn7cj" (UniqueName: "kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj") pod "network-check-target-nwdnf" (UID: "c4f30495-8f9d-433a-9e5d-da96145ab5f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 19:35:19.837412 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.837358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:19.837412 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.837358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:19.837728 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.837498    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:19.837728 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:19.837610    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:19.911992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:19.911954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:20.159854 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.159821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:20.172414 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.172388    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc26931b-f9cb-4077-9c00-a41a3354a4e3" containerID="420c748298cd3a8b6e083202f9e1f985a498013ca342fc45fc4298d2fe5ae624" exitCode=0
Jul 24 19:35:20.172525 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.172451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerDied","Data":"420c748298cd3a8b6e083202f9e1f985a498013ca342fc45fc4298d2fe5ae624"}
Jul 24 19:35:20.260253 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.260228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:20.359931 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.359907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:20.466650 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.466601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:20.609344 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.609322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:20.836961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:20.836898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:20.837062 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:20.837005    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:21.177041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:21.177018    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc26931b-f9cb-4077-9c00-a41a3354a4e3" containerID="5062df3d479b822b2fa0cdc0bf5c9f6aa5e2b0e39a7b1b23d1a73bbd8ea75164" exitCode=0
Jul 24 19:35:21.177364 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:21.177062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerDied","Data":"5062df3d479b822b2fa0cdc0bf5c9f6aa5e2b0e39a7b1b23d1a73bbd8ea75164"}
Jul 24 19:35:21.609634 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:21.609571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:21.837392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:21.837363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:21.837514 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:21.837468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:21.837567 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:21.837518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:21.837614 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:21.837598    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:22.010711 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.010685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:22.186944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.186904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" event={"ID":"fc26931b-f9cb-4077-9c00-a41a3354a4e3","Type":"ContainerStarted","Data":"13ca88fa1bf9cc1abf7b13d9a5b16bbc22171f1f066eeef17ceeca3cc0e57341"}
Jul 24 19:35:22.209407 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.209368    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rfrf7" podStartSLOduration=7.216762405 podStartE2EDuration="36.209353387s" totalImagesPullingTime="28.992590982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:22.208978117 +0000 UTC m=+35.853241157" watchObservedRunningTime="2026-07-24 19:35:22.209353387 +0000 UTC m=+35.853616430"
Jul 24 19:35:22.210156 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.210136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:22.411388 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.411367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:22.523765 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.523747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:22.809024 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.808965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:22.837097 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:22.837083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:22.837199 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:22.837181    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:23.406342 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:23.406316    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:23.600423 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:23.600388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:23.731802 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:23.731777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:23.832420 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:23.832397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:23.837393 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:23.837377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:23.837447 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:23.837395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:23.837519 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:23.837487    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:23.837630 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:23.837611    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:24.204118 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.204089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:24.479545 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.479472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:24.538639 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.538612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:24.605253 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.605231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:24.705535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.705509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:24.807098 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.807032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:24.837445 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:24.837424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:24.837544 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:24.837520    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:25.401427 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:25.401398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:25.836475 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:25.836438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:25.836811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:25.836441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:25.836811 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:25.836553    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:25.836811 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:25.836622    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:26.006753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.006727    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:26.106800 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.106735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:26.207430 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.207405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:26.408831 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.408809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:26.609372 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.609347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:26.821388 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.821327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:26.838147 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:26.838125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:26.838439 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:26.838196    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:27.813907 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:27.813871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:27.837020 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:27.837001    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:27.837100 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:27.837084    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:27.837170 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:27.837157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:27.837251 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:27.837238    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:28.009269 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:28.009224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:28.202324 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:28.202301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:28.401426 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:28.401400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:28.603260 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:28.603185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:28.836757 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:28.836736    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:28.836914 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:28.836823    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:29.310170 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.310114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:29.410214 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.410187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:29.462319 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.462296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:29.606995 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.606919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:29.707188 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.707161    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:29.807419 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.807392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:29.837517 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.837491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:29.837672 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.837643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:29.837766 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:29.837651    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:29.837766 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:29.837743    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:29.986946 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:29.986917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.087384 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.087357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.203151 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.203121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.256282 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.256222    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.408439 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.408408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.457836 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.457809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.600092 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.600023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:30.836670 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.836629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:30.836830 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:30.836736    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:30.999022 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:30.998994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:31.200496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:31.200453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:31.301406 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:31.301333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:31.837070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:31.837042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:31.837514 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:31.837148    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:31.837514 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:31.837219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:31.837514 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:31.837300    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:32.015817 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:32.015786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:32.837314 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:32.837285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:32.837685 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:32.837376    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:33.836894 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:33.836859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:33.837053 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:33.836862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:33.837053 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:33.836962    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:33.837053 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:33.837037    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:34.836699 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:34.836667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:34.837156 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:34.836756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:35.836821 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:35.836793    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:35.837177 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:35.836800    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:35.837177 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:35.836883    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j464j" podUID="67c3f51b-c2de-41c4-a2ff-0943d1e75372"
Jul 24 19:35:35.837177 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:35.836962    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8vms" podUID="8ab1f5c3-d764-4742-8d9e-af785ea7e1d3"
Jul 24 19:35:36.520178 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:36.520145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:36.614327 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:36.614300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:36.714400 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:36.714378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:36.811505 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:36.811439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:36.837415 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:36.837396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:36.837751 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:36.837499    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nwdnf" podUID="c4f30495-8f9d-433a-9e5d-da96145ab5f9"
Jul 24 19:35:37.187500 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.187479    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeReady"
Jul 24 19:35:37.187675 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.187571    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 19:35:37.233788 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.233759    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dzjtp"]
Jul 24 19:35:37.247401 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.247382    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fs8zk"]
Jul 24 19:35:37.247534 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.247518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.250541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.250522    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p8txj\""
Jul 24 19:35:37.251148 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.251129    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 19:35:37.251257 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.251175    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 19:35:37.261339 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.261319    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzjtp"]
Jul 24 19:35:37.261417 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.261350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fs8zk"]
Jul 24 19:35:37.261467 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.261429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.264527 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.264512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 19:35:37.265230 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.265203    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 19:35:37.265436 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.265410    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 19:35:37.265944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.265927    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mq7m6\""
Jul 24 19:35:37.274001 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.273985    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 19:35:37.341100 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.341077    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nws7k"]
Jul 24 19:35:37.363505 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.363486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nws7k"]
Jul 24 19:35:37.363585 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.363562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.366863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.366848    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 19:35:37.367013 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.366864    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zq8nd\""
Jul 24 19:35:37.367074 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.367060    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 19:35:37.367125 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.367112    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 19:35:37.401846 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.401823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9r7x\" (UniqueName: \"kubernetes.io/projected/21dc86dd-dad3-470b-a0ce-701f9fd264c2-kube-api-access-t9r7x\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.401933 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.401852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21dc86dd-dad3-470b-a0ce-701f9fd264c2-config-volume\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.401933 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.401868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21dc86dd-dad3-470b-a0ce-701f9fd264c2-metrics-tls\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.401933 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.401882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81b8c57a-d6d8-4819-8501-20501b859ff2-crio-socket\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.402041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.401941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81b8c57a-d6d8-4819-8501-20501b859ff2-data-volume\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.402041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.401966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b8c57a-d6d8-4819-8501-20501b859ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.402041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.402006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlpjd\" (UniqueName: \"kubernetes.io/projected/81b8c57a-d6d8-4819-8501-20501b859ff2-kube-api-access-xlpjd\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.402177 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.402048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21dc86dd-dad3-470b-a0ce-701f9fd264c2-tmp-dir\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.402177 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.402130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b8c57a-d6d8-4819-8501-20501b859ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.409461 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.409439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:37.466595 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.466544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:37.503225 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21dc86dd-dad3-470b-a0ce-701f9fd264c2-tmp-dir\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.503303 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b8c57a-d6d8-4819-8501-20501b859ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503303 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9r7x\" (UniqueName: \"kubernetes.io/projected/21dc86dd-dad3-470b-a0ce-701f9fd264c2-kube-api-access-t9r7x\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.503303 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21dc86dd-dad3-470b-a0ce-701f9fd264c2-config-volume\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.503437 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21dc86dd-dad3-470b-a0ce-701f9fd264c2-metrics-tls\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.503437 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81b8c57a-d6d8-4819-8501-20501b859ff2-crio-socket\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503437 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2236125-f3ed-4308-b97f-0d34cbf2f348-cert\") pod \"ingress-canary-nws7k\" (UID: \"b2236125-f3ed-4308-b97f-0d34cbf2f348\") " pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.503437 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81b8c57a-d6d8-4819-8501-20501b859ff2-data-volume\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503437 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b8c57a-d6d8-4819-8501-20501b859ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503686 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlpjd\" (UniqueName: \"kubernetes.io/projected/81b8c57a-d6d8-4819-8501-20501b859ff2-kube-api-access-xlpjd\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503686 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htm9n\" (UniqueName: \"kubernetes.io/projected/b2236125-f3ed-4308-b97f-0d34cbf2f348-kube-api-access-htm9n\") pod \"ingress-canary-nws7k\" (UID: \"b2236125-f3ed-4308-b97f-0d34cbf2f348\") " pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.503686 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21dc86dd-dad3-470b-a0ce-701f9fd264c2-tmp-dir\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.503832 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81b8c57a-d6d8-4819-8501-20501b859ff2-data-volume\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503832 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81b8c57a-d6d8-4819-8501-20501b859ff2-crio-socket\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.503933 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.503918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21dc86dd-dad3-470b-a0ce-701f9fd264c2-config-volume\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.507001 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.506982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b8c57a-d6d8-4819-8501-20501b859ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.511092 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.511070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlpjd\" (UniqueName: \"kubernetes.io/projected/81b8c57a-d6d8-4819-8501-20501b859ff2-kube-api-access-xlpjd\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.515518 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.515501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b8c57a-d6d8-4819-8501-20501b859ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fs8zk\" (UID: \"81b8c57a-d6d8-4819-8501-20501b859ff2\") " pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.517639 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.517625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21dc86dd-dad3-470b-a0ce-701f9fd264c2-metrics-tls\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.519116 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.519100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9r7x\" (UniqueName: \"kubernetes.io/projected/21dc86dd-dad3-470b-a0ce-701f9fd264c2-kube-api-access-t9r7x\") pod \"dns-default-dzjtp\" (UID: \"21dc86dd-dad3-470b-a0ce-701f9fd264c2\") " pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.557074 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.557055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:37.569198 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.569181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fs8zk"
Jul 24 19:35:37.604067 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.604049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2236125-f3ed-4308-b97f-0d34cbf2f348-cert\") pod \"ingress-canary-nws7k\" (UID: \"b2236125-f3ed-4308-b97f-0d34cbf2f348\") " pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.604174 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.604095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htm9n\" (UniqueName: \"kubernetes.io/projected/b2236125-f3ed-4308-b97f-0d34cbf2f348-kube-api-access-htm9n\") pod \"ingress-canary-nws7k\" (UID: \"b2236125-f3ed-4308-b97f-0d34cbf2f348\") " pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.607559 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.607537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2236125-f3ed-4308-b97f-0d34cbf2f348-cert\") pod \"ingress-canary-nws7k\" (UID: \"b2236125-f3ed-4308-b97f-0d34cbf2f348\") " pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.611942 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.611921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htm9n\" (UniqueName: \"kubernetes.io/projected/b2236125-f3ed-4308-b97f-0d34cbf2f348-kube-api-access-htm9n\") pod \"ingress-canary-nws7k\" (UID: \"b2236125-f3ed-4308-b97f-0d34cbf2f348\") " pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.673894 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.673701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nws7k"
Jul 24 19:35:37.764141 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.764112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzjtp"]
Jul 24 19:35:37.767735 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:37.767709    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21dc86dd_dad3_470b_a0ce_701f9fd264c2.slice/crio-69bfa0e806370e65beb34dd3cf19503587cc46573a76b1a133cda2990f97c7a3 WatchSource:0}: Error finding container 69bfa0e806370e65beb34dd3cf19503587cc46573a76b1a133cda2990f97c7a3: Status 404 returned error can't find the container with id 69bfa0e806370e65beb34dd3cf19503587cc46573a76b1a133cda2990f97c7a3
Jul 24 19:35:37.780693 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.780670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fs8zk"]
Jul 24 19:35:37.794544 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:37.794522    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b8c57a_d6d8_4819_8501_20501b859ff2.slice/crio-f20f38c9c060f462d09b4d012e8f1161a145c6e2eead7bf07bf357900c6bfdd3 WatchSource:0}: Error finding container f20f38c9c060f462d09b4d012e8f1161a145c6e2eead7bf07bf357900c6bfdd3: Status 404 returned error can't find the container with id f20f38c9c060f462d09b4d012e8f1161a145c6e2eead7bf07bf357900c6bfdd3
Jul 24 19:35:37.818100 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.818075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nws7k"]
Jul 24 19:35:37.821129 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:37.821101    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2236125_f3ed_4308_b97f_0d34cbf2f348.slice/crio-b478874ab6cd5fb2ac52d98e3acc37875dc378365905ce4454cfe6e7ddac0c35 WatchSource:0}: Error finding container b478874ab6cd5fb2ac52d98e3acc37875dc378365905ce4454cfe6e7ddac0c35: Status 404 returned error can't find the container with id b478874ab6cd5fb2ac52d98e3acc37875dc378365905ce4454cfe6e7ddac0c35
Jul 24 19:35:37.837370 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.837351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:37.837480 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.837358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:37.839880 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.839865    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:35:37.839940 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.839878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:35:37.839940 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:37.839878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srqs8\""
Jul 24 19:35:38.026708 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.026618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:38.075970 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.075950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:38.220158 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.220123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nws7k" event={"ID":"b2236125-f3ed-4308-b97f-0d34cbf2f348","Type":"ContainerStarted","Data":"b478874ab6cd5fb2ac52d98e3acc37875dc378365905ce4454cfe6e7ddac0c35"}
Jul 24 19:35:38.221424 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.221384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs8zk" event={"ID":"81b8c57a-d6d8-4819-8501-20501b859ff2","Type":"ContainerStarted","Data":"f20f38c9c060f462d09b4d012e8f1161a145c6e2eead7bf07bf357900c6bfdd3"}
Jul 24 19:35:38.222427 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.222396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzjtp" event={"ID":"21dc86dd-dad3-470b-a0ce-701f9fd264c2","Type":"ContainerStarted","Data":"69bfa0e806370e65beb34dd3cf19503587cc46573a76b1a133cda2990f97c7a3"}
Jul 24 19:35:38.842972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.842934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:38.846443 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.846008    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:35:38.848261 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.847172    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:35:38.848261 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:38.847475    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n5p7p\""
Jul 24 19:35:40.033840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:40.033797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:40.134929 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:40.134827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:41.233355 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:41.233277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzjtp" event={"ID":"21dc86dd-dad3-470b-a0ce-701f9fd264c2","Type":"ContainerStarted","Data":"e431e42900176481b884030b21afb018d68a5ac362338e2e0e67582237c9df65"}
Jul 24 19:35:41.837241 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:41.837192    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:41.891517 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:41.891485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:42.030523 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.030492    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7984b95864-vwbrf"]
Jul 24 19:35:42.042901 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.042876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.044992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.044961    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7984b95864-vwbrf"]
Jul 24 19:35:42.045593 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.045570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 19:35:42.045811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.045790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wnkzl\""
Jul 24 19:35:42.045811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.045804    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 19:35:42.045985 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.045799    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 19:35:42.046747 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.046723    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 19:35:42.046868 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.046824    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 19:35:42.046940 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.046924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 19:35:42.046997 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.046952    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 19:35:42.141816 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.141748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-service-ca\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.141816 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.141785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-serving-cert\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.142035 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.141863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngcb\" (UniqueName: \"kubernetes.io/projected/9053a124-2f35-4c74-a651-87794283043d-kube-api-access-tngcb\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.142035 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.141919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-oauth-config\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.142035 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.141961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-console-config\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.142185 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.142042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-oauth-serving-cert\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.242759 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.242730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-serving-cert\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243199 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.242779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngcb\" (UniqueName: \"kubernetes.io/projected/9053a124-2f35-4c74-a651-87794283043d-kube-api-access-tngcb\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243199 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.242803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-oauth-config\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243199 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.242840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-console-config\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243199 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.242870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-oauth-serving-cert\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243199 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.242899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-service-ca\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243662 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.243622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-service-ca\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243754 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.243675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-console-config\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.243754 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.243698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-oauth-serving-cert\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.245361 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.245340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-oauth-config\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.245470 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.245386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-serving-cert\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.250515 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.250496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngcb\" (UniqueName: \"kubernetes.io/projected/9053a124-2f35-4c74-a651-87794283043d-kube-api-access-tngcb\") pod \"console-7984b95864-vwbrf\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") " pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:42.355412 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:42.355373    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:43.204012 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.203972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:43.304631 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.304599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:43.659753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.659724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7984b95864-vwbrf"]
Jul 24 19:35:43.663694 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:43.663658    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9053a124_2f35_4c74_a651_87794283043d.slice/crio-b0e720c02228a13ec559fdfa4cf49970c46de3fd67d80694e07366878a8407f7 WatchSource:0}: Error finding container b0e720c02228a13ec559fdfa4cf49970c46de3fd67d80694e07366878a8407f7: Status 404 returned error can't find the container with id b0e720c02228a13ec559fdfa4cf49970c46de3fd67d80694e07366878a8407f7
Jul 24 19:35:43.827690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.827596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:43.830548 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.830527    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798fc4b7dd-qz4pq"]
Jul 24 19:35:43.832212 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.832197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.841163 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.841145    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 19:35:43.843572 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.843552    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798fc4b7dd-qz4pq"]
Jul 24 19:35:43.853963 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.853939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8knk\" (UniqueName: \"kubernetes.io/projected/0e390ee6-f2ff-47bb-996b-e01e13edd69b-kube-api-access-h8knk\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.854051 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.853980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-oauth-config\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.854102 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.854055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-service-ca\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.854102 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.854076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-oauth-serving-cert\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.854102 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.854096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-serving-cert\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.854189 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.854119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-config\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.854189 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.854139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-trusted-ca-bundle\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.886981 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.886946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:43.955237 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8knk\" (UniqueName: \"kubernetes.io/projected/0e390ee6-f2ff-47bb-996b-e01e13edd69b-kube-api-access-h8knk\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.955313 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-oauth-config\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.955313 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-service-ca\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.955313 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955304    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-oauth-serving-cert\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.955447 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-serving-cert\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.955447 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-config\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.955447 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.955389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-trusted-ca-bundle\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.956067 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.956042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-service-ca\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.956187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.956049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-config\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.956187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.956133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-oauth-serving-cert\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.956302 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.956261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-trusted-ca-bundle\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.957654 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.957637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-oauth-config\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.957749 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.957734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-serving-cert\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:43.962851 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:43.962835    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8knk\" (UniqueName: \"kubernetes.io/projected/0e390ee6-f2ff-47bb-996b-e01e13edd69b-kube-api-access-h8knk\") pod \"console-798fc4b7dd-qz4pq\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") " pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:44.141125 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.141046    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:44.248255 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.248094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nws7k" event={"ID":"b2236125-f3ed-4308-b97f-0d34cbf2f348","Type":"ContainerStarted","Data":"581ca26c243e963c62075eaa4857bb8dcff0690556aaefa842f7104fb28398e7"}
Jul 24 19:35:44.251335 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.251260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs8zk" event={"ID":"81b8c57a-d6d8-4819-8501-20501b859ff2","Type":"ContainerStarted","Data":"d494a72b1d8e6ff2d4dfd597f22a4095fdaf3fd1f0bef103b1ba624988facdaa"}
Jul 24 19:35:44.254686 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.254626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzjtp" event={"ID":"21dc86dd-dad3-470b-a0ce-701f9fd264c2","Type":"ContainerStarted","Data":"945ced91d9d62c63b51acd65e9bdced6001eab6bbbac9e321505bd4607a2f95d"}
Jul 24 19:35:44.255085 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.254998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:44.258847 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.258824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984b95864-vwbrf" event={"ID":"9053a124-2f35-4c74-a651-87794283043d","Type":"ContainerStarted","Data":"b0e720c02228a13ec559fdfa4cf49970c46de3fd67d80694e07366878a8407f7"}
Jul 24 19:35:44.265434 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.264835    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nws7k" podStartSLOduration=1.562088423 podStartE2EDuration="7.264818625s" totalImagesPullingTime="5.702730202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:44.264210364 +0000 UTC m=+57.908473405" watchObservedRunningTime="2026-07-24 19:35:44.264818625 +0000 UTC m=+57.909081666"
Jul 24 19:35:44.280644 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.280594    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dzjtp" podStartSLOduration=4.873731579 podStartE2EDuration="7.280576139s" totalImagesPullingTime="2.40684456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:44.279524529 +0000 UTC m=+57.923787571" watchObservedRunningTime="2026-07-24 19:35:44.280576139 +0000 UTC m=+57.924839172"
Jul 24 19:35:44.304502 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:44.304475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798fc4b7dd-qz4pq"]
Jul 24 19:35:45.265366 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:45.265305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fc4b7dd-qz4pq" event={"ID":"0e390ee6-f2ff-47bb-996b-e01e13edd69b","Type":"ContainerStarted","Data":"4df50dfa6fb235ad13e926b8c3159f78262ad8c839e60ecc0804dd5c2031bb32"}
Jul 24 19:35:46.175350 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:46.175318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgjmb"
Jul 24 19:35:46.302178 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:46.302143    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:46.362111 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:46.362062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:46.420698 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:46.420673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:47.997950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:47.997910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.098157 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.098125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.197952 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.197919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.271719 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.271645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.275117 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.275085    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"]
Jul 24 19:35:48.279640 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.279614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:48.282024 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.282006    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-glzsp\""
Jul 24 19:35:48.282024 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.282015    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 24 19:35:48.287596 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.287545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"]
Jul 24 19:35:48.392278 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.392249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bda32a9a-eb45-4d36-9403-d16f79f5720d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pqmq5\" (UID: \"bda32a9a-eb45-4d36-9403-d16f79f5720d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:48.493213 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.493181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bda32a9a-eb45-4d36-9403-d16f79f5720d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pqmq5\" (UID: \"bda32a9a-eb45-4d36-9403-d16f79f5720d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:48.493389 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:48.493324    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 24 19:35:48.493469 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:48.493400    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda32a9a-eb45-4d36-9403-d16f79f5720d-tls-certificates podName:bda32a9a-eb45-4d36-9403-d16f79f5720d nodeName:}" failed. No retries permitted until 2026-07-24 19:35:48.99337982 +0000 UTC m=+62.637642837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/bda32a9a-eb45-4d36-9403-d16f79f5720d-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-pqmq5" (UID: "bda32a9a-eb45-4d36-9403-d16f79f5720d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 24 19:35:48.624876 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.624796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.677858 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.677542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.984727 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.984699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:48.998305 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:48.998282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bda32a9a-eb45-4d36-9403-d16f79f5720d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pqmq5\" (UID: \"bda32a9a-eb45-4d36-9403-d16f79f5720d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:49.000664 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.000635    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bda32a9a-eb45-4d36-9403-d16f79f5720d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-pqmq5\" (UID: \"bda32a9a-eb45-4d36-9403-d16f79f5720d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:49.190024 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.189996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:49.280109 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.280029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs8zk" event={"ID":"81b8c57a-d6d8-4819-8501-20501b859ff2","Type":"ContainerStarted","Data":"322ae97c2fb7b99c36c60b9055c93a69f7659b10c5943c1009b4e0a47db06c7b"}
Jul 24 19:35:49.282013 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.281985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fc4b7dd-qz4pq" event={"ID":"0e390ee6-f2ff-47bb-996b-e01e13edd69b","Type":"ContainerStarted","Data":"0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4"}
Jul 24 19:35:49.284012 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.283988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984b95864-vwbrf" event={"ID":"9053a124-2f35-4c74-a651-87794283043d","Type":"ContainerStarted","Data":"65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b"}
Jul 24 19:35:49.300776 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.300726    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798fc4b7dd-qz4pq" podStartSLOduration=1.821657265 podStartE2EDuration="6.300708015s" totalImagesPullingTime="4.47905075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:49.299240399 +0000 UTC m=+62.943503440" watchObservedRunningTime="2026-07-24 19:35:49.300708015 +0000 UTC m=+62.944971036"
Jul 24 19:35:49.316892 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.316796    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7984b95864-vwbrf" podStartSLOduration=2.191979491 podStartE2EDuration="7.316780834s" totalImagesPullingTime="5.124801343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:49.316423425 +0000 UTC m=+62.960686466" watchObservedRunningTime="2026-07-24 19:35:49.316780834 +0000 UTC m=+62.961043876"
Jul 24 19:35:49.322181 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:49.322159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"]
Jul 24 19:35:49.327805 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:49.327782    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda32a9a_eb45_4d36_9403_d16f79f5720d.slice/crio-4ddfd939faf02fa0d9aabdd1e6cad0f3c523ad21068b95ed8e919523955c2f50 WatchSource:0}: Error finding container 4ddfd939faf02fa0d9aabdd1e6cad0f3c523ad21068b95ed8e919523955c2f50: Status 404 returned error can't find the container with id 4ddfd939faf02fa0d9aabdd1e6cad0f3c523ad21068b95ed8e919523955c2f50
Jul 24 19:35:50.261955 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:50.261864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:50.289181 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:50.289101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5" event={"ID":"bda32a9a-eb45-4d36-9403-d16f79f5720d","Type":"ContainerStarted","Data":"4ddfd939faf02fa0d9aabdd1e6cad0f3c523ad21068b95ed8e919523955c2f50"}
Jul 24 19:35:50.330209 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:50.330177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:51.141965 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.141933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:51.267647 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.267612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dzjtp"
Jul 24 19:35:51.294041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.294001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5" event={"ID":"bda32a9a-eb45-4d36-9403-d16f79f5720d","Type":"ContainerStarted","Data":"7a034c03b5cba28547d6cdf8ecf14f5bb711a5679b37eca1a454a36becf8a2a1"}
Jul 24 19:35:51.294191 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.294164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:51.300142 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.300120    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5"
Jul 24 19:35:51.316618 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.316567    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-pqmq5" podStartSLOduration=2.177970565 podStartE2EDuration="3.316547888s" totalImagesPullingTime="1.138577323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:51.315235326 +0000 UTC m=+64.959498368" watchObservedRunningTime="2026-07-24 19:35:51.316547888 +0000 UTC m=+64.960810929"
Jul 24 19:35:51.620907 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.620876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:51.621086 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.620940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:51.624068 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.624040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 19:35:51.624224 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.624206    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 19:35:51.634241 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.634217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67c3f51b-c2de-41c4-a2ff-0943d1e75372-original-pull-secret\") pod \"global-pull-secret-syncer-j464j\" (UID: \"67c3f51b-c2de-41c4-a2ff-0943d1e75372\") " pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:51.634342 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.634268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ab1f5c3-d764-4742-8d9e-af785ea7e1d3-metrics-certs\") pod \"network-metrics-daemon-d8vms\" (UID: \"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3\") " pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:51.646957 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.646931    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j464j"
Jul 24 19:35:51.655322 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.655304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-srqs8\""
Jul 24 19:35:51.662475 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.662437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8vms"
Jul 24 19:35:51.722132 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.722109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:51.724856 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.724833    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 19:35:51.735486 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.735467    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 19:35:51.745874 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.745857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7cj\" (UniqueName: \"kubernetes.io/projected/c4f30495-8f9d-433a-9e5d-da96145ab5f9-kube-api-access-rn7cj\") pod \"network-check-target-nwdnf\" (UID: \"c4f30495-8f9d-433a-9e5d-da96145ab5f9\") " pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:51.760216 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.760198    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n5p7p\""
Jul 24 19:35:51.767528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:51.767512    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:52.310226 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.309672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:52.355553 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.355504    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:52.355823 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.355767    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:52.362836 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.362813    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:52.371120 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.371103    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"]
Jul 24 19:35:52.376100 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.375479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.376100 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.375953    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8vms"]
Jul 24 19:35:52.378870 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.378418    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 19:35:52.378870 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.378638    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 19:35:52.378870 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.378716    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lrwxv\""
Jul 24 19:35:52.379227 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.378954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 19:35:52.379227 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.378974    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 19:35:52.379329 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.379278    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 19:35:52.380885 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:52.380859    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab1f5c3_d764_4742_8d9e_af785ea7e1d3.slice/crio-5989c1e01e375d185d9588608d469cf2627dec154a152b29e958c54909ccb35a WatchSource:0}: Error finding container 5989c1e01e375d185d9588608d469cf2627dec154a152b29e958c54909ccb35a: Status 404 returned error can't find the container with id 5989c1e01e375d185d9588608d469cf2627dec154a152b29e958c54909ccb35a
Jul 24 19:35:52.383978 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.383758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"]
Jul 24 19:35:52.389042 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.388896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nwdnf"]
Jul 24 19:35:52.391238 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:52.391215    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f30495_8f9d_433a_9e5d_da96145ab5f9.slice/crio-e83ca3d594e2848f4fe984f863204a959cbd633dfc9ca0a7794dd7f485e83ee9 WatchSource:0}: Error finding container e83ca3d594e2848f4fe984f863204a959cbd633dfc9ca0a7794dd7f485e83ee9: Status 404 returned error can't find the container with id e83ca3d594e2848f4fe984f863204a959cbd633dfc9ca0a7794dd7f485e83ee9
Jul 24 19:35:52.410704 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.410684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j464j"]
Jul 24 19:35:52.413591 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:52.413570    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c3f51b_c2de_41c4_a2ff_0943d1e75372.slice/crio-d919b0789340833dccaf8f63922a031f1bad58983e72800b60f82aaaa19a0f77 WatchSource:0}: Error finding container d919b0789340833dccaf8f63922a031f1bad58983e72800b60f82aaaa19a0f77: Status 404 returned error can't find the container with id d919b0789340833dccaf8f63922a031f1bad58983e72800b60f82aaaa19a0f77
Jul 24 19:35:52.413715 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.413686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:52.426336 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.426318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.426428 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.426388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.426564 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.426546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.426621 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.426579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2tqd\" (UniqueName: \"kubernetes.io/projected/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-kube-api-access-v2tqd\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.527659 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.527610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.527743 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.527657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.527743 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.527682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.527743 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.527697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2tqd\" (UniqueName: \"kubernetes.io/projected/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-kube-api-access-v2tqd\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.527743 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:52.527737    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 24 19:35:52.527871 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:35:52.527786    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-tls podName:36dc8bc8-20a3-4e77-bdb3-cbc2d540124b nodeName:}" failed. No retries permitted until 2026-07-24 19:35:53.027772047 +0000 UTC m=+66.672035065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-n2h2g" (UID: "36dc8bc8-20a3-4e77-bdb3-cbc2d540124b") : secret "prometheus-operator-tls" not found
Jul 24 19:35:52.528315 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.528297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.529940 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.529919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:52.536150 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:52.536132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2tqd\" (UniqueName: \"kubernetes.io/projected/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-kube-api-access-v2tqd\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:53.021084 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.021052    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:53.030099 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.030049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:53.032901 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.032876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/36dc8bc8-20a3-4e77-bdb3-cbc2d540124b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-n2h2g\" (UID: \"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:53.287405 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.287271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"
Jul 24 19:35:53.309993 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.309924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nwdnf" event={"ID":"c4f30495-8f9d-433a-9e5d-da96145ab5f9","Type":"ContainerStarted","Data":"e83ca3d594e2848f4fe984f863204a959cbd633dfc9ca0a7794dd7f485e83ee9"}
Jul 24 19:35:53.311442 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.311411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8vms" event={"ID":"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3","Type":"ContainerStarted","Data":"5989c1e01e375d185d9588608d469cf2627dec154a152b29e958c54909ccb35a"}
Jul 24 19:35:53.314339 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.314314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fs8zk" event={"ID":"81b8c57a-d6d8-4819-8501-20501b859ff2","Type":"ContainerStarted","Data":"2ff1a0377645b92de3049cca6661344bbe02a49a8b81e1b95ee36b1dccfcf851"}
Jul 24 19:35:53.316314 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.316252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j464j" event={"ID":"67c3f51b-c2de-41c4-a2ff-0943d1e75372","Type":"ContainerStarted","Data":"d919b0789340833dccaf8f63922a031f1bad58983e72800b60f82aaaa19a0f77"}
Jul 24 19:35:53.327350 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.324923    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:35:53.336493 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.336432    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fs8zk" podStartSLOduration=1.971327272 podStartE2EDuration="16.336415257s" totalImagesPullingTime="14.365087985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:35:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:53.335837947 +0000 UTC m=+66.980100987" watchObservedRunningTime="2026-07-24 19:35:53.336415257 +0000 UTC m=+66.980678300"
Jul 24 19:35:53.699486 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:53.699429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-n2h2g"]
Jul 24 19:35:53.703661 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:35:53.703540    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36dc8bc8_20a3_4e77_bdb3_cbc2d540124b.slice/crio-a9e57be0a3c8fc823be64865fd7ac4d14b06b96fe1f5d9d7218655a13f978cce WatchSource:0}: Error finding container a9e57be0a3c8fc823be64865fd7ac4d14b06b96fe1f5d9d7218655a13f978cce: Status 404 returned error can't find the container with id a9e57be0a3c8fc823be64865fd7ac4d14b06b96fe1f5d9d7218655a13f978cce
Jul 24 19:35:54.142548 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.142121    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:54.142548 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.142184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:54.147532 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.147481    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:54.229334 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.229302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:54.324154 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.324116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8vms" event={"ID":"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3","Type":"ContainerStarted","Data":"185811dda0d0a5261759e8ddc6c66da7d7b6472b17b949d1440b05ff8317d77b"}
Jul 24 19:35:54.324606 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.324180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8vms" event={"ID":"8ab1f5c3-d764-4742-8d9e-af785ea7e1d3","Type":"ContainerStarted","Data":"8ad3024bbf7e899b2ad57c20dd9db8f10c7037904216ffe373d511b207d5ebcd"}
Jul 24 19:35:54.325791 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.325765    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g" event={"ID":"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b","Type":"ContainerStarted","Data":"a9e57be0a3c8fc823be64865fd7ac4d14b06b96fe1f5d9d7218655a13f978cce"}
Jul 24 19:35:54.332183 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.332164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:35:54.336879 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.336842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:54.381623 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.381575    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d8vms" podStartSLOduration=66.869226295 podStartE2EDuration="1m8.381556669s" totalImagesPullingTime="1.512330374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:54.359728108 +0000 UTC m=+68.003991149" watchObservedRunningTime="2026-07-24 19:35:54.381556669 +0000 UTC m=+68.025819713"
Jul 24 19:35:54.411635 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.411585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7984b95864-vwbrf"]
Jul 24 19:35:54.475820 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.475787    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:54.566732 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:54.566702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:55.028142 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:55.028109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:55.125287 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:55.125256    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:55.750470 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:55.750414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:55.851382 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:55.851344    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:55.956148 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:55.956119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:56.057218 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:56.057140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:57.073361 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:57.073326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:57.128944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:57.128909    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:57.654822 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:57.654753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:58.341940 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.341904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nwdnf" event={"ID":"c4f30495-8f9d-433a-9e5d-da96145ab5f9","Type":"ContainerStarted","Data":"80864a27e2c391ad2a483c4288b434d6cb8158ba5fcd03aadbc48fb34979d6d2"}
Jul 24 19:35:58.342361 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.341977    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:35:58.343725 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.343709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g" event={"ID":"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b","Type":"ContainerStarted","Data":"fc5c200685e5da3326aad63b578e3e1107acd24f80709fb41e2faf2e0fd200d1"}
Jul 24 19:35:58.343781 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.343742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g" event={"ID":"36dc8bc8-20a3-4e77-bdb3-cbc2d540124b","Type":"ContainerStarted","Data":"ed3305f61f6350c4769fe2d0e8b3fa45678719386f6000400ad06373b24c85ea"}
Jul 24 19:35:58.345023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.344992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j464j" event={"ID":"67c3f51b-c2de-41c4-a2ff-0943d1e75372","Type":"ContainerStarted","Data":"74f99a7ad03ef9c91d9629e9a328d2ecab8bb51bffda304fcb317012236ac2d9"}
Jul 24 19:35:58.358309 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.358272    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nwdnf" podStartSLOduration=67.398094156 podStartE2EDuration="1m12.358259607s" totalImagesPullingTime="4.960165451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:58.35718126 +0000 UTC m=+72.001444298" watchObservedRunningTime="2026-07-24 19:35:58.358259607 +0000 UTC m=+72.002522647"
Jul 24 19:35:58.373134 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.373096    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j464j" podStartSLOduration=66.422582564 podStartE2EDuration="1m11.373084627s" totalImagesPullingTime="4.950502063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:58.372422982 +0000 UTC m=+72.016686022" watchObservedRunningTime="2026-07-24 19:35:58.373084627 +0000 UTC m=+72.017347667"
Jul 24 19:35:58.389582 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:58.389542    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-n2h2g" podStartSLOduration=2.742871549 podStartE2EDuration="6.389530569s" totalImagesPullingTime="3.64665902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:35:58.389052315 +0000 UTC m=+72.033315354" watchObservedRunningTime="2026-07-24 19:35:58.389530569 +0000 UTC m=+72.033793610"
Jul 24 19:35:59.043061 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:59.043029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:59.100508 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:59.100473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:35:59.159740 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:35:59.159714    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.382161 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.382128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.483081 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.483050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.583774 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.583745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.683908 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.683884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.706569 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.706548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"]
Jul 24 19:36:00.709702 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.709687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.712292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.712271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 19:36:00.712384 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.712271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 19:36:00.713152 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.713137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d59cm\""
Jul 24 19:36:00.724506 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.724485    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"]
Jul 24 19:36:00.732747 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.732727    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"]
Jul 24 19:36:00.735808 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.735793    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.738485 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.738447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 19:36:00.738590 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.738447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 19:36:00.738590 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.738502    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9nxcq\""
Jul 24 19:36:00.739319 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.739299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 19:36:00.742223 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.742163    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-czrv2"]
Jul 24 19:36:00.745277 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.745263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.747822 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.747801    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 19:36:00.748184 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.748162    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 19:36:00.748335 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.748309    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 19:36:00.748606 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.748570    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z4drf\""
Jul 24 19:36:00.748825 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.748809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"]
Jul 24 19:36:00.763726 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.763704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.796244 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-wtmp\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796342 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b528eb1-3285-4a67-a437-a52327d06a26-metrics-client-ca\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796342 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e474248e-bd1e-4fe1-8943-39498e0c2982-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.796342 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f2b07d8-3625-4984-84bf-b2726da4844d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.796508 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5b6\" (UniqueName: \"kubernetes.io/projected/3b528eb1-3285-4a67-a437-a52327d06a26-kube-api-access-qt5b6\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796508 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e474248e-bd1e-4fe1-8943-39498e0c2982-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.796508 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-tls\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796508 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l88qc\" (UniqueName: \"kubernetes.io/projected/1f2b07d8-3625-4984-84bf-b2726da4844d-kube-api-access-l88qc\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.796508 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-textfile\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f2b07d8-3625-4984-84bf-b2726da4844d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-sys\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-accelerators-collector-config\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.796678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2b07d8-3625-4984-84bf-b2726da4844d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.796913 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mps8\" (UniqueName: \"kubernetes.io/projected/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-api-access-5mps8\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.796913 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.796913 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.796755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-root\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.835067 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.835046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:00.898069 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-textfile\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898185 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f2b07d8-3625-4984-84bf-b2726da4844d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.898185 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898185 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.898185 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-sys\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898185 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-accelerators-collector-config\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2b07d8-3625-4984-84bf-b2726da4844d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.898440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-sys\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mps8\" (UniqueName: \"kubernetes.io/projected/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-api-access-5mps8\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.898440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.898440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-root\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-wtmp\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b528eb1-3285-4a67-a437-a52327d06a26-metrics-client-ca\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-textfile\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e474248e-bd1e-4fe1-8943-39498e0c2982-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f2b07d8-3625-4984-84bf-b2726da4844d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5b6\" (UniqueName: \"kubernetes.io/projected/3b528eb1-3285-4a67-a437-a52327d06a26-kube-api-access-qt5b6\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e474248e-bd1e-4fe1-8943-39498e0c2982-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-tls\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-wtmp\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l88qc\" (UniqueName: \"kubernetes.io/projected/1f2b07d8-3625-4984-84bf-b2726da4844d-kube-api-access-l88qc\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.898723 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.898708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b528eb1-3285-4a67-a437-a52327d06a26-root\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.899354 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.899007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2b07d8-3625-4984-84bf-b2726da4844d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.899354 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.899062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e474248e-bd1e-4fe1-8943-39498e0c2982-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.899354 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.899088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-accelerators-collector-config\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.899354 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:00.899321    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 19:36:00.899620 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.899364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b528eb1-3285-4a67-a437-a52327d06a26-metrics-client-ca\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.899620 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:00.899385    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-tls podName:3b528eb1-3285-4a67-a437-a52327d06a26 nodeName:}" failed. No retries permitted until 2026-07-24 19:36:01.39936704 +0000 UTC m=+75.043630076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-tls") pod "node-exporter-czrv2" (UID: "3b528eb1-3285-4a67-a437-a52327d06a26") : secret "node-exporter-tls" not found
Jul 24 19:36:00.900057 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.900030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.900496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.900475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e474248e-bd1e-4fe1-8943-39498e0c2982-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.900925 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.900905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.901403 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.901381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.901530 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.901514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f2b07d8-3625-4984-84bf-b2726da4844d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.901643 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.901627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.901872 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.901857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f2b07d8-3625-4984-84bf-b2726da4844d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.907604 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.907584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5b6\" (UniqueName: \"kubernetes.io/projected/3b528eb1-3285-4a67-a437-a52327d06a26-kube-api-access-qt5b6\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:00.908398 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.908379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mps8\" (UniqueName: \"kubernetes.io/projected/e474248e-bd1e-4fe1-8943-39498e0c2982-kube-api-access-5mps8\") pod \"kube-state-metrics-56d9f944b4-pfzrg\" (UID: \"e474248e-bd1e-4fe1-8943-39498e0c2982\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:00.908560 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.908541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l88qc\" (UniqueName: \"kubernetes.io/projected/1f2b07d8-3625-4984-84bf-b2726da4844d-kube-api-access-l88qc\") pod \"openshift-state-metrics-b8f49f5c6-g4686\" (UID: \"1f2b07d8-3625-4984-84bf-b2726da4844d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:00.923865 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:00.923842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:01.018869 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.018800    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"
Jul 24 19:36:01.023572 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.023550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:01.045221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.045192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"
Jul 24 19:36:01.137558 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.137422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:01.173002 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.172972    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686"]
Jul 24 19:36:01.175997 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:01.175959    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2b07d8_3625_4984_84bf_b2726da4844d.slice/crio-a538eb5d7c3a5c0f42c72bd3e20f77c4b2fbfe0bccbf8b50db8a42436ea2e253 WatchSource:0}: Error finding container a538eb5d7c3a5c0f42c72bd3e20f77c4b2fbfe0bccbf8b50db8a42436ea2e253: Status 404 returned error can't find the container with id a538eb5d7c3a5c0f42c72bd3e20f77c4b2fbfe0bccbf8b50db8a42436ea2e253
Jul 24 19:36:01.200844 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.200736    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg"]
Jul 24 19:36:01.203267 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:01.203247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode474248e_bd1e_4fe1_8943_39498e0c2982.slice/crio-81e63b62010e3b89feef0c7ca13ee258c92a70a79bf3599f3cf1c997738c53c0 WatchSource:0}: Error finding container 81e63b62010e3b89feef0c7ca13ee258c92a70a79bf3599f3cf1c997738c53c0: Status 404 returned error can't find the container with id 81e63b62010e3b89feef0c7ca13ee258c92a70a79bf3599f3cf1c997738c53c0
Jul 24 19:36:01.359420 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.359367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:01.359570 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.359545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686" event={"ID":"1f2b07d8-3625-4984-84bf-b2726da4844d","Type":"ContainerStarted","Data":"1746d770d05add3fcef5d1d5e821e36eeb2e6d88487892ae4d9fef96613ceea0"}
Jul 24 19:36:01.359639 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.359607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686" event={"ID":"1f2b07d8-3625-4984-84bf-b2726da4844d","Type":"ContainerStarted","Data":"6138e70afb08c93d4989b21f0bbba678ca5864c93568d3f1b7eca49dd84ed4c2"}
Jul 24 19:36:01.359698 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.359637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686" event={"ID":"1f2b07d8-3625-4984-84bf-b2726da4844d","Type":"ContainerStarted","Data":"a538eb5d7c3a5c0f42c72bd3e20f77c4b2fbfe0bccbf8b50db8a42436ea2e253"}
Jul 24 19:36:01.360633 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.360605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg" event={"ID":"e474248e-bd1e-4fe1-8943-39498e0c2982","Type":"ContainerStarted","Data":"81e63b62010e3b89feef0c7ca13ee258c92a70a79bf3599f3cf1c997738c53c0"}
Jul 24 19:36:01.403076 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.403049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-tls\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:01.405304 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.405286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b528eb1-3285-4a67-a437-a52327d06a26-node-exporter-tls\") pod \"node-exporter-czrv2\" (UID: \"3b528eb1-3285-4a67-a437-a52327d06a26\") " pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:01.653821 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.653730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-czrv2"
Jul 24 19:36:01.664201 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:01.664172    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b528eb1_3285_4a67_a437_a52327d06a26.slice/crio-495928caefd7313595bd74ac02b51c5db69e6816936baf2ab2fa6c6928393df0 WatchSource:0}: Error finding container 495928caefd7313595bd74ac02b51c5db69e6816936baf2ab2fa6c6928393df0: Status 404 returned error can't find the container with id 495928caefd7313595bd74ac02b51c5db69e6816936baf2ab2fa6c6928393df0
Jul 24 19:36:01.704510 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.704477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:01.796632 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.796597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:01.802152 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.802131    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 19:36:01.807372 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.807347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.810541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.810512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 19:36:01.810630 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.810487    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 19:36:01.810690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.810645    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 19:36:01.811107 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811087    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 19:36:01.811172 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 19:36:01.811172 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811122    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 19:36:01.811704 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811652    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 19:36:01.811704 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811652    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 19:36:01.811704 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811686    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 19:36:01.811901 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.811678    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tjqtb\""
Jul 24 19:36:01.824700 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.824679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 19:36:01.907703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8083b225-26b4-4ae9-9682-afa8d06a2fc0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.907703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8083b225-26b4-4ae9-9682-afa8d06a2fc0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.907703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.907937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8083b225-26b4-4ae9-9682-afa8d06a2fc0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.907937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.907937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.907937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8083b225-26b4-4ae9-9682-afa8d06a2fc0-config-out\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.908127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-web-config\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.908127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.907990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.908127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.908020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.908127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.908062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhb4\" (UniqueName: \"kubernetes.io/projected/8083b225-26b4-4ae9-9682-afa8d06a2fc0-kube-api-access-dzhb4\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.908127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.908107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:01.908356 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:01.908150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8083b225-26b4-4ae9-9682-afa8d06a2fc0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009544 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhb4\" (UniqueName: \"kubernetes.io/projected/8083b225-26b4-4ae9-9682-afa8d06a2fc0-kube-api-access-dzhb4\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009685 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009685 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8083b225-26b4-4ae9-9682-afa8d06a2fc0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009685 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8083b225-26b4-4ae9-9682-afa8d06a2fc0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009685 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8083b225-26b4-4ae9-9682-afa8d06a2fc0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009685 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8083b225-26b4-4ae9-9682-afa8d06a2fc0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8083b225-26b4-4ae9-9682-afa8d06a2fc0-config-out\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-web-config\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.009944 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.009882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.010321 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.010171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8083b225-26b4-4ae9-9682-afa8d06a2fc0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.010321 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:02.010302    2560 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 24 19:36:02.010423 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:02.010377    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-main-tls podName:8083b225-26b4-4ae9-9682-afa8d06a2fc0 nodeName:}" failed. No retries permitted until 2026-07-24 19:36:02.510357157 +0000 UTC m=+76.154620190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8083b225-26b4-4ae9-9682-afa8d06a2fc0") : secret "alertmanager-main-tls" not found
Jul 24 19:36:02.010597 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.010575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8083b225-26b4-4ae9-9682-afa8d06a2fc0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.010859 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.010836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8083b225-26b4-4ae9-9682-afa8d06a2fc0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.012592 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.012536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8083b225-26b4-4ae9-9682-afa8d06a2fc0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.012730 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.012690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.012901 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.012859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8083b225-26b4-4ae9-9682-afa8d06a2fc0-config-out\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.013401 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.013361    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.013504 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.013418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.013910 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.013887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.013962 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.013925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.013999 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.013970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-web-config\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.018377 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.018360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhb4\" (UniqueName: \"kubernetes.io/projected/8083b225-26b4-4ae9-9682-afa8d06a2fc0-kube-api-access-dzhb4\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.117731 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.117692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:02.366509 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.366471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czrv2" event={"ID":"3b528eb1-3285-4a67-a437-a52327d06a26","Type":"ContainerStarted","Data":"495928caefd7313595bd74ac02b51c5db69e6816936baf2ab2fa6c6928393df0"}
Jul 24 19:36:02.429324 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.429287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:02.515288 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.515250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.517706 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.517685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8083b225-26b4-4ae9-9682-afa8d06a2fc0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8083b225-26b4-4ae9-9682-afa8d06a2fc0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:02.716945 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:02.716906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 19:36:03.221738 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.221700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 19:36:03.227748 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:03.227671    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8083b225_26b4_4ae9_9682_afa8d06a2fc0.slice/crio-5a2e82439513d7e1fa44a8a260ea870ca26ed6808080e3f10c3e907f78da250d WatchSource:0}: Error finding container 5a2e82439513d7e1fa44a8a260ea870ca26ed6808080e3f10c3e907f78da250d: Status 404 returned error can't find the container with id 5a2e82439513d7e1fa44a8a260ea870ca26ed6808080e3f10c3e907f78da250d
Jul 24 19:36:03.372181 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.372139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg" event={"ID":"e474248e-bd1e-4fe1-8943-39498e0c2982","Type":"ContainerStarted","Data":"71353dccd56828d04561e7d550d5250bfd8428a3e0896ffb6afae0bb673675e3"}
Jul 24 19:36:03.372312 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.372203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg" event={"ID":"e474248e-bd1e-4fe1-8943-39498e0c2982","Type":"ContainerStarted","Data":"c8ceeaa7ee1d969e05b4fff80c4ef8c1ba4b03df9c51b7ea69031d0149e142d8"}
Jul 24 19:36:03.372312 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.372265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg" event={"ID":"e474248e-bd1e-4fe1-8943-39498e0c2982","Type":"ContainerStarted","Data":"d5bed2d4357d26ff772c7a142ce0878bbcc753cb568ad1e1edb8ef4b48345afa"}
Jul 24 19:36:03.373972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.373945    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b528eb1-3285-4a67-a437-a52327d06a26" containerID="fe3ae299518f07ad2144985395841ebd1f6936a0ad0fac7a204ad1b696cfe209" exitCode=0
Jul 24 19:36:03.374074 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.374027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czrv2" event={"ID":"3b528eb1-3285-4a67-a437-a52327d06a26","Type":"ContainerDied","Data":"fe3ae299518f07ad2144985395841ebd1f6936a0ad0fac7a204ad1b696cfe209"}
Jul 24 19:36:03.376513 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.376491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686" event={"ID":"1f2b07d8-3625-4984-84bf-b2726da4844d","Type":"ContainerStarted","Data":"b011ead2cd1a02d07783821a95ea7c486903d599ab1519bea329d2621b77196c"}
Jul 24 19:36:03.377667 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.377648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"5a2e82439513d7e1fa44a8a260ea870ca26ed6808080e3f10c3e907f78da250d"}
Jul 24 19:36:03.391442 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.391397    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pfzrg" podStartSLOduration=1.525509314 podStartE2EDuration="3.391383919s" totalImagesPullingTime="1.865874605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:03.38995606 +0000 UTC m=+77.034219113" watchObservedRunningTime="2026-07-24 19:36:03.391383919 +0000 UTC m=+77.035646936"
Jul 24 19:36:03.410560 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.410514    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-g4686" podStartSLOduration=1.616842873 podStartE2EDuration="3.410450862s" totalImagesPullingTime="1.793607989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:03.409758229 +0000 UTC m=+77.054021270" watchObservedRunningTime="2026-07-24 19:36:03.410450862 +0000 UTC m=+77.054713902"
Jul 24 19:36:03.681324 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.681288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:03.704867 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.704840    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"]
Jul 24 19:36:03.708586 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.708568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.711201 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 19:36:03.711201 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 19:36:03.711344 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 19:36:03.711344 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711302    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 19:36:03.711535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711521    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 19:36:03.711925 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711905    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-978p9\""
Jul 24 19:36:03.711972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.711948    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a0c6im448kpfe\""
Jul 24 19:36:03.721108 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.721087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"]
Jul 24 19:36:03.751623 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.751599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:03.826605 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-metrics-client-ca\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826792 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-grpc-tls\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826792 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4kj\" (UniqueName: \"kubernetes.io/projected/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-kube-api-access-nf4kj\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826792 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.826887 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.826812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-tls\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.861299 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.861261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:03.927448 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4kj\" (UniqueName: \"kubernetes.io/projected/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-kube-api-access-nf4kj\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927544 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927544 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-tls\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927544 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-metrics-client-ca\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927737 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927737 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927737 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.927737 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.927643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-grpc-tls\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.928815 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.928794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-metrics-client-ca\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.930189 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.930160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.930269 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.930236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.930417 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.930401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.930606 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.930589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.930606 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.930597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-thanos-querier-tls\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.930690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.930675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-secret-grpc-tls\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:03.935186 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:03.935149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4kj\" (UniqueName: \"kubernetes.io/projected/0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7-kube-api-access-nf4kj\") pod \"thanos-querier-54649cdbd7-xrbtq\" (UID: \"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7\") " pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:04.018174 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.018150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:04.164899 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.164728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"]
Jul 24 19:36:04.167922 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:04.167894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0885cbf5_8ae3_424a_8a02_f5cf7cebb0a7.slice/crio-43fbf0d9a26d2b92e8e85f6a08b50452ceb1efbc9a6e531f9b2cb506e19844af WatchSource:0}: Error finding container 43fbf0d9a26d2b92e8e85f6a08b50452ceb1efbc9a6e531f9b2cb506e19844af: Status 404 returned error can't find the container with id 43fbf0d9a26d2b92e8e85f6a08b50452ceb1efbc9a6e531f9b2cb506e19844af
Jul 24 19:36:04.383327 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.383235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"43fbf0d9a26d2b92e8e85f6a08b50452ceb1efbc9a6e531f9b2cb506e19844af"}
Jul 24 19:36:04.385756 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.385689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czrv2" event={"ID":"3b528eb1-3285-4a67-a437-a52327d06a26","Type":"ContainerStarted","Data":"e4d1cc4acff2b4b1d2b4c7c460b8f9f480a5ababbe43d021c9f7533867af3444"}
Jul 24 19:36:04.385878 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.385758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-czrv2" event={"ID":"3b528eb1-3285-4a67-a437-a52327d06a26","Type":"ContainerStarted","Data":"70704c0c3b4e37698bad2fd5b6f7c9bc0cb1d2dd1ee4a15c2aaa32936e80d9fd"}
Jul 24 19:36:04.403979 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.403930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-czrv2" podStartSLOduration=2.90094042 podStartE2EDuration="4.403906876s" totalImagesPullingTime="1.404852348s" totalInitContainerRuntime="98.114108ms" isStatefulPod=true podCreationTimestamp="2026-07-24 19:36:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:04.402851894 +0000 UTC m=+78.047114961" watchObservedRunningTime="2026-07-24 19:36:04.403906876 +0000 UTC m=+78.048169916"
Jul 24 19:36:04.634535 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:04.634401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:05.035848 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.035803    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68c798f594-nz527"]
Jul 24 19:36:05.039432 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.039412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.042206 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.042185    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 19:36:05.042307 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.042260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-npvlt\""
Jul 24 19:36:05.042427 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.042185    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 19:36:05.043326 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.043281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 19:36:05.043418 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.043333    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 19:36:05.043418 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.043281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8pjiec65pdecs\""
Jul 24 19:36:05.048481 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.048444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68c798f594-nz527"]
Jul 24 19:36:05.137840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.137812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-audit-log\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.137927 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.137853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-metrics-server-audit-profiles\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.137927 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.137893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-secret-metrics-server-client-certs\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.138019 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.137950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-client-ca-bundle\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.138067 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.138031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-secret-metrics-server-tls\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.138106 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.138077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.138151 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.138113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj945\" (UniqueName: \"kubernetes.io/projected/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-kube-api-access-pj945\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239377 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239531 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj945\" (UniqueName: \"kubernetes.io/projected/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-kube-api-access-pj945\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239531 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-audit-log\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239531 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-metrics-server-audit-profiles\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239531 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-secret-metrics-server-client-certs\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239712 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-client-ca-bundle\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239712 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-secret-metrics-server-tls\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.239904 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.239861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-audit-log\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.240190 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.240154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.240566 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.240544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-metrics-server-audit-profiles\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.242379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.242359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-secret-metrics-server-tls\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.242476 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.242392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-secret-metrics-server-client-certs\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.242611 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.242482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-client-ca-bundle\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.249109 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.249086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj945\" (UniqueName: \"kubernetes.io/projected/c20ccd3c-7a3d-4eac-a588-d13ec5ab7256-kube-api-access-pj945\") pod \"metrics-server-68c798f594-nz527\" (UID: \"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256\") " pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.350594 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.350537    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:05.392215 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.392183    2560 generic.go:356] "Generic (PLEG): container finished" podID="8083b225-26b4-4ae9-9682-afa8d06a2fc0" containerID="21b7ea86890da8bd928eb123b87203e2d878554f67917ee1c029fce9b835fd45" exitCode=0
Jul 24 19:36:05.392362 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.392275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerDied","Data":"21b7ea86890da8bd928eb123b87203e2d878554f67917ee1c029fce9b835fd45"}
Jul 24 19:36:05.495651 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.495622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68c798f594-nz527"]
Jul 24 19:36:05.498363 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:05.498341    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20ccd3c_7a3d_4eac_a588_d13ec5ab7256.slice/crio-56736e3711164e349a970e728dac0eea2587b4ff0b8d67c73ddf8e20fd6b2131 WatchSource:0}: Error finding container 56736e3711164e349a970e728dac0eea2587b4ff0b8d67c73ddf8e20fd6b2131: Status 404 returned error can't find the container with id 56736e3711164e349a970e728dac0eea2587b4ff0b8d67c73ddf8e20fd6b2131
Jul 24 19:36:05.504769 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.504740    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6499bf87-fszdk"]
Jul 24 19:36:05.509641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.509614    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"]
Jul 24 19:36:05.509745 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.509733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.512802 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.512764    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:05.515152 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.515136    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 19:36:05.515275 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.515194    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v4zzp\""
Jul 24 19:36:05.518011 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.517993    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"]
Jul 24 19:36:05.522837 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.522814    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6499bf87-fszdk"]
Jul 24 19:36:05.523494 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.523449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:05.578511 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.578480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:05.642830 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.642760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42hb\" (UniqueName: \"kubernetes.io/projected/7029cee0-e325-4fa1-8dd9-40cdcf90434a-kube-api-access-t42hb\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.642830 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.642813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-serving-cert\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.643036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.642888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-trusted-ca-bundle\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.643036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.642970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n479j\" (UniqueName: \"kubernetes.io/projected/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-kube-api-access-n479j\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:05.643036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.643021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-oauth-config\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.643188 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.643078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-service-ca\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.643188 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.643113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-oauth-serving-cert\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.643188 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.643138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-config\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.643303 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.643206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:05.683830 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.683804    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:05.743998 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.743973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-oauth-config\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744153 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-service-ca\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744153 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-oauth-serving-cert\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744238 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-config\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744349 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744284    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:05.744349 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42hb\" (UniqueName: \"kubernetes.io/projected/7029cee0-e325-4fa1-8dd9-40cdcf90434a-kube-api-access-t42hb\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744555 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-serving-cert\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744555 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-trusted-ca-bundle\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.744555 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n479j\" (UniqueName: \"kubernetes.io/projected/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-kube-api-access-n479j\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:05.744555 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:05.744449    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 24 19:36:05.744555 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:05.744537    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert podName:5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3 nodeName:}" failed. No retries permitted until 2026-07-24 19:36:06.244511257 +0000 UTC m=+79.888774293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-5lw6n" (UID: "5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3") : secret "monitoring-plugin-cert" not found
Jul 24 19:36:05.744934 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-service-ca\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.745032 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.744944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-config\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.745104 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.745042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-oauth-serving-cert\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.745485 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.745446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-trusted-ca-bundle\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.747099 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.747079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-oauth-config\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.747183 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.747170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-serving-cert\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.752596 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.752573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42hb\" (UniqueName: \"kubernetes.io/projected/7029cee0-e325-4fa1-8dd9-40cdcf90434a-kube-api-access-t42hb\") pod \"console-7c6499bf87-fszdk\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") " pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:05.752596 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.752587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n479j\" (UniqueName: \"kubernetes.io/projected/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-kube-api-access-n479j\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:05.783969 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.783932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:05.826241 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:05.826215    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:06.227124 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.225072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6499bf87-fszdk"]
Jul 24 19:36:06.229622 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:06.229578    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7029cee0_e325_4fa1_8dd9_40cdcf90434a.slice/crio-29fdd4f44d7cdd769f56142dcf62843e6a443bb3b09e55074dedf09b5d00efee WatchSource:0}: Error finding container 29fdd4f44d7cdd769f56142dcf62843e6a443bb3b09e55074dedf09b5d00efee: Status 404 returned error can't find the container with id 29fdd4f44d7cdd769f56142dcf62843e6a443bb3b09e55074dedf09b5d00efee
Jul 24 19:36:06.250048 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.250017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:06.250176 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:06.250162    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 24 19:36:06.250245 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:06.250222    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert podName:5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3 nodeName:}" failed. No retries permitted until 2026-07-24 19:36:07.250204625 +0000 UTC m=+80.894467642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-5lw6n" (UID: "5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3") : secret "monitoring-plugin-cert" not found
Jul 24 19:36:06.402632 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.402595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"c886615e13236b7018fc61f8b7454ddaba48f16a4384573b06a5e53ba86b026e"}
Jul 24 19:36:06.402811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.402681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"9f7690954ea2833db854537c247ad419e4bea92943a08da71498fd415a59362b"}
Jul 24 19:36:06.402811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.402723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"df90440bb4eca391a8ce76c7e39e201c21f3eacc2518884fa502e51c00eff502"}
Jul 24 19:36:06.405304 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.404793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6499bf87-fszdk" event={"ID":"7029cee0-e325-4fa1-8dd9-40cdcf90434a","Type":"ContainerStarted","Data":"716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e"}
Jul 24 19:36:06.405304 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.404840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6499bf87-fszdk" event={"ID":"7029cee0-e325-4fa1-8dd9-40cdcf90434a","Type":"ContainerStarted","Data":"29fdd4f44d7cdd769f56142dcf62843e6a443bb3b09e55074dedf09b5d00efee"}
Jul 24 19:36:06.406897 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.406872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68c798f594-nz527" event={"ID":"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256","Type":"ContainerStarted","Data":"56736e3711164e349a970e728dac0eea2587b4ff0b8d67c73ddf8e20fd6b2131"}
Jul 24 19:36:06.507409 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.507376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:06.607665 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.607603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:06.995735 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.994267    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6499bf87-fszdk" podStartSLOduration=1.994246268 podStartE2EDuration="1.994246268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:06.42273265 +0000 UTC m=+80.066995703" watchObservedRunningTime="2026-07-24 19:36:06.994246268 +0000 UTC m=+80.638509309"
Jul 24 19:36:06.995735 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.995434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:06.996581 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:06.996195    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 19:36:07.002259 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.002235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.004985 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.004764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 19:36:07.005105 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.005047    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 19:36:07.005105 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.005068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8b6guqbgtnhac\""
Jul 24 19:36:07.005546 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.005302    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 19:36:07.005546 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.005500    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.005841    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.005893    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.006083    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.006304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hdgkd\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.006510    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.006580    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.006686    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 19:36:07.006807 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.006755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 19:36:07.008809 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.007652    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 19:36:07.008809 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.008536    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 19:36:07.014927 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.014908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 19:36:07.018960 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.018751    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a320ccac-9b98-4ab4-af64-46890a41ee7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161496 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-config\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcs5k\" (UniqueName: \"kubernetes.io/projected/a320ccac-9b98-4ab4-af64-46890a41ee7c-kube-api-access-fcs5k\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.161992 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.161982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.162369 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.162040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a320ccac-9b98-4ab4-af64-46890a41ee7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.162369 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.162070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.262863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-config\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.262863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.262863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.262974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcs5k\" (UniqueName: \"kubernetes.io/projected/a320ccac-9b98-4ab4-af64-46890a41ee7c-kube-api-access-fcs5k\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a320ccac-9b98-4ab4-af64-46890a41ee7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a320ccac-9b98-4ab4-af64-46890a41ee7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.263408 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.264236 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.264236 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.263380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.264236 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.264094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.266289 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.265065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.266289 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.265079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.266289 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.265324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.266289 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.265877    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.268489 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.267802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.268489 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.268181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.268750 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.268724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.269245 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.269221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.271267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.271159    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-5lw6n\" (UID: \"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:07.271889 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.271732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.271889 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.271852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.272167 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.272097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a320ccac-9b98-4ab4-af64-46890a41ee7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.272661 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.272639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.272858 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.272842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcs5k\" (UniqueName: \"kubernetes.io/projected/a320ccac-9b98-4ab4-af64-46890a41ee7c-kube-api-access-fcs5k\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.273701 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.273676    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a320ccac-9b98-4ab4-af64-46890a41ee7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.274390 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.274348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-config\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.274541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.274521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a320ccac-9b98-4ab4-af64-46890a41ee7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.274706 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.274684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.274764 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.274749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a320ccac-9b98-4ab4-af64-46890a41ee7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a320ccac-9b98-4ab4-af64-46890a41ee7c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.316961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.316932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:07.332991 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:07.332966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:08.043957 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.043930    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 19:36:08.049016 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.048946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"]
Jul 24 19:36:08.052758 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:36:08.052725    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a99db37_0bf4_404d_a9a4_cbc0f06dcdd3.slice/crio-234c9c9c66fc5bd1f93cefee4bc5e1909158416f466da1ce25168f76e4ab3d41 WatchSource:0}: Error finding container 234c9c9c66fc5bd1f93cefee4bc5e1909158416f466da1ce25168f76e4ab3d41: Status 404 returned error can't find the container with id 234c9c9c66fc5bd1f93cefee4bc5e1909158416f466da1ce25168f76e4ab3d41
Jul 24 19:36:08.418119 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.418090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68c798f594-nz527" event={"ID":"c20ccd3c-7a3d-4eac-a588-d13ec5ab7256","Type":"ContainerStarted","Data":"4871aaf631b7afe74b3650fa441cbead53e848ecb220da024496818e2b52b1a2"}
Jul 24 19:36:08.421098 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.421075    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"2d5edd22a1cf24dc1db8cd5c02a6ef7367d48ae5b4176759ed04e8ef6df04271"}
Jul 24 19:36:08.421201 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.421142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"2298ddbc2499072bc1b164419b7ed4e3fcaaaa7b311bec1b3e0c76e080130865"}
Jul 24 19:36:08.421201 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.421184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" event={"ID":"0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7","Type":"ContainerStarted","Data":"4d68ef8791e1c03d4a6db25a376f0e407ad562992f0ad3a7cba00e4df1c8308b"}
Jul 24 19:36:08.421352 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.421226    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:08.425115 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.425089    2560 generic.go:356] "Generic (PLEG): container finished" podID="a320ccac-9b98-4ab4-af64-46890a41ee7c" containerID="73910d81b62c044d156b0029f99d8f273b0583af9aa2f4e7c214af079cb1c419" exitCode=0
Jul 24 19:36:08.425210 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.425174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerDied","Data":"73910d81b62c044d156b0029f99d8f273b0583af9aa2f4e7c214af079cb1c419"}
Jul 24 19:36:08.425263 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.425240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"d5dacd1abc646ba0631d6a5caa878c6bba031c5f771e5ac3a449904185897142"}
Jul 24 19:36:08.429080 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.429059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"67d103656ea7f62f91e7fbb8d8e7a285c19795a696e637f49e698de238693a17"}
Jul 24 19:36:08.429169 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.429125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"72abba3961e7fbd9f61f073c10f4bd57c7414a9be7e906b51cfa2a69b29c3382"}
Jul 24 19:36:08.429240 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.429173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"fb90362f5953094348dee174f8c1a68e96edb185000d656847c976b8bb2d972c"}
Jul 24 19:36:08.429240 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.429212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"ab68a6976de365980c3ef8fcde92f0f1b64dcf5af0b3a329ce12d23251ca6107"}
Jul 24 19:36:08.429352 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.429250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"b4da638267155101649c1a32407fb1bd6486c34e61a972243a8a1c7a5ae38d49"}
Jul 24 19:36:08.429352 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.429274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8083b225-26b4-4ae9-9682-afa8d06a2fc0","Type":"ContainerStarted","Data":"a20e07f36a89189c25fbb4dc66f6b2292bc64410457ec9b93586382e9ed2cd20"}
Jul 24 19:36:08.430258 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.430238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n" event={"ID":"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3","Type":"ContainerStarted","Data":"234c9c9c66fc5bd1f93cefee4bc5e1909158416f466da1ce25168f76e4ab3d41"}
Jul 24 19:36:08.434988 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.434940    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68c798f594-nz527" podStartSLOduration=1.064847932 podStartE2EDuration="3.434923369s" totalImagesPullingTime="2.370075437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:08.433846046 +0000 UTC m=+82.078109087" watchObservedRunningTime="2026-07-24 19:36:08.434923369 +0000 UTC m=+82.079186414"
Jul 24 19:36:08.458389 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.458348    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.648053702 podStartE2EDuration="7.458330878s" totalImagesPullingTime="3.79078708s" totalInitContainerRuntime="19.490096ms" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:08.455586464 +0000 UTC m=+82.099849508" watchObservedRunningTime="2026-07-24 19:36:08.458330878 +0000 UTC m=+82.102593921"
Jul 24 19:36:08.503557 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:08.503423    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq" podStartSLOduration=2.029248344 podStartE2EDuration="5.503404315s" totalImagesPullingTime="3.474155971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:08.502365871 +0000 UTC m=+82.146628912" watchObservedRunningTime="2026-07-24 19:36:08.503404315 +0000 UTC m=+82.147667355"
Jul 24 19:36:09.391389 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:09.391331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:09.438622 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:09.438574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:10.443379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:10.443348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n" event={"ID":"5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3","Type":"ContainerStarted","Data":"1652abdff7a752cbc2312901b57618650b0d36e288dbf3a5afb5d776818342d6"}
Jul 24 19:36:10.443855 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:10.443574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:10.449100 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:10.449072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n"
Jul 24 19:36:10.461791 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:10.461740    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-5lw6n" podStartSLOduration=3.957905672 podStartE2EDuration="5.461724672s" totalImagesPullingTime="1.503819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:10.460793983 +0000 UTC m=+84.105057034" watchObservedRunningTime="2026-07-24 19:36:10.461724672 +0000 UTC m=+84.105987713"
Jul 24 19:36:11.103386 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:11.103344    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:11.153390 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:11.153361    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:12.454793 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.454752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"351e96cc72b7296881540cf8ebedc75366cd9a018de24359a41b37273b8ef70b"}
Jul 24 19:36:12.455131 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.454856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"c4ff657a95abae0baa921ec767003ab11f97aebc2589f44d444aa910151f2b32"}
Jul 24 19:36:12.455131 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.454887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"77e27cae123a996d4c193afd3d79031d6192308b0d9cea66cd61672211bdb851"}
Jul 24 19:36:12.455131 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.454913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"08e5cb2bb2a275a0de43c6e6388296949809a77a01601876745be94589223e00"}
Jul 24 19:36:12.455131 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.454950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"b849e49ad813f3f255bf4b4300daf0bfc85ea736667c605f911abe6e267bc661"}
Jul 24 19:36:12.455131 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.454988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a320ccac-9b98-4ab4-af64-46890a41ee7c","Type":"ContainerStarted","Data":"14b06faaaf39fabb82a72b692fdcf1ea522c0c8eb6146f28b3aa2e0302c7fe3f"}
Jul 24 19:36:12.483918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:12.483865    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.2658708929999998 podStartE2EDuration="6.483845344s" totalImagesPullingTime="3.195442679s" totalInitContainerRuntime="22.531772ms" isStatefulPod=false podCreationTimestamp="2026-07-24 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:36:12.482193307 +0000 UTC m=+86.126456380" watchObservedRunningTime="2026-07-24 19:36:12.483845344 +0000 UTC m=+86.128108389"
Jul 24 19:36:14.442983 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:14.442955    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54649cdbd7-xrbtq"
Jul 24 19:36:15.827095 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:15.827067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:15.827443 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:15.827142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:15.831639 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:15.831623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:16.477272 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:16.477247    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:36:16.524366 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:16.524340    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798fc4b7dd-qz4pq"]
Jul 24 19:36:16.621438 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:16.621409    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:16.671147 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:16.671126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:16.721583 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:16.721563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:17.317566 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:17.317535    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:36:21.353430 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:21.353394    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7984b95864-vwbrf" podUID="9053a124-2f35-4c74-a651-87794283043d" containerName="console" containerID="cri-o://65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b" gracePeriod=15
Jul 24 19:36:21.506034 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:21.506002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:21.560115 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:21.560086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:22.137641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.137616    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:36:22.291019 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.290944    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-oauth-serving-cert\") pod \"9053a124-2f35-4c74-a651-87794283043d\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") "
Jul 24 19:36:22.291019 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.290987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-serving-cert\") pod \"9053a124-2f35-4c74-a651-87794283043d\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") "
Jul 24 19:36:22.291221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291029    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-service-ca\") pod \"9053a124-2f35-4c74-a651-87794283043d\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") "
Jul 24 19:36:22.291221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291089    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-console-config\") pod \"9053a124-2f35-4c74-a651-87794283043d\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") "
Jul 24 19:36:22.291221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291140    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-oauth-config\") pod \"9053a124-2f35-4c74-a651-87794283043d\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") "
Jul 24 19:36:22.291221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tngcb\" (UniqueName: \"kubernetes.io/projected/9053a124-2f35-4c74-a651-87794283043d-kube-api-access-tngcb\") pod \"9053a124-2f35-4c74-a651-87794283043d\" (UID: \"9053a124-2f35-4c74-a651-87794283043d\") "
Jul 24 19:36:22.291400 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9053a124-2f35-4c74-a651-87794283043d" (UID: "9053a124-2f35-4c74-a651-87794283043d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:22.293961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291758    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-service-ca" (OuterVolumeSpecName: "service-ca") pod "9053a124-2f35-4c74-a651-87794283043d" (UID: "9053a124-2f35-4c74-a651-87794283043d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:22.293961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.291990    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-console-config" (OuterVolumeSpecName: "console-config") pod "9053a124-2f35-4c74-a651-87794283043d" (UID: "9053a124-2f35-4c74-a651-87794283043d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:22.293961 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.292027    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:22.294440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.294408    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9053a124-2f35-4c74-a651-87794283043d" (UID: "9053a124-2f35-4c74-a651-87794283043d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:36:22.295001 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.294834    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9053a124-2f35-4c74-a651-87794283043d-kube-api-access-tngcb" (OuterVolumeSpecName: "kube-api-access-tngcb") pod "9053a124-2f35-4c74-a651-87794283043d" (UID: "9053a124-2f35-4c74-a651-87794283043d"). InnerVolumeSpecName "kube-api-access-tngcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:36:22.297507 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.295262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9053a124-2f35-4c74-a651-87794283043d" (UID: "9053a124-2f35-4c74-a651-87794283043d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:36:22.393243 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.393221    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:22.393243 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.393240    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:22.393650 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.393274    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tngcb\" (UniqueName: \"kubernetes.io/projected/9053a124-2f35-4c74-a651-87794283043d-kube-api-access-tngcb\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:22.393650 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.393283    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9053a124-2f35-4c74-a651-87794283043d-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:22.393650 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.393292    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9053a124-2f35-4c74-a651-87794283043d-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:22.499600 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.499571    2560 generic.go:356] "Generic (PLEG): container finished" podID="9053a124-2f35-4c74-a651-87794283043d" containerID="65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b" exitCode=0
Jul 24 19:36:22.499686 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.499620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984b95864-vwbrf" event={"ID":"9053a124-2f35-4c74-a651-87794283043d","Type":"ContainerDied","Data":"65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b"}
Jul 24 19:36:22.499686 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.499670    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7984b95864-vwbrf"
Jul 24 19:36:22.499753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.499718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7984b95864-vwbrf" event={"ID":"9053a124-2f35-4c74-a651-87794283043d","Type":"ContainerDied","Data":"b0e720c02228a13ec559fdfa4cf49970c46de3fd67d80694e07366878a8407f7"}
Jul 24 19:36:22.510019 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.510001    2560 scope.go:117] "RemoveContainer" containerID="65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b"
Jul 24 19:36:22.518354 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.518333    2560 scope.go:117] "RemoveContainer" containerID="65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b"
Jul 24 19:36:22.518698 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:22.518667    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b\": container with ID starting with 65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b not found: ID does not exist" containerID="65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b"
Jul 24 19:36:22.518779 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.518705    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b"} err="failed to get container status \"65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b\": rpc error: code = NotFound desc = could not find container \"65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b\": container with ID starting with 65f1dc09233a8e29359fb02bf26cefd9fcdd2f38849324dac1bb1833cd7e843b not found: ID does not exist"
Jul 24 19:36:22.520019 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.519997    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7984b95864-vwbrf"]
Jul 24 19:36:22.523579 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.523560    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7984b95864-vwbrf"]
Jul 24 19:36:22.842102 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:22.842072    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9053a124-2f35-4c74-a651-87794283043d" path="/var/lib/kubelet/pods/9053a124-2f35-4c74-a651-87794283043d/volumes"
Jul 24 19:36:23.918709 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:23.918685    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/init-config-reloader/0.log"
Jul 24 19:36:24.118868 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:24.118794    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/alertmanager/0.log"
Jul 24 19:36:24.318647 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:24.318618    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/config-reloader/0.log"
Jul 24 19:36:24.518765 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:24.518740    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/kube-rbac-proxy-web/0.log"
Jul 24 19:36:24.718638 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:24.718612    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/kube-rbac-proxy/0.log"
Jul 24 19:36:24.918146 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:24.918123    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/kube-rbac-proxy-metric/0.log"
Jul 24 19:36:25.118855 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:25.118831    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/prom-label-proxy/0.log"
Jul 24 19:36:25.350787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:25.350724    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:25.350787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:25.350780    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:25.519334 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:25.519309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pfzrg_e474248e-bd1e-4fe1-8943-39498e0c2982/kube-state-metrics/0.log"
Jul 24 19:36:25.718241 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:25.718222    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pfzrg_e474248e-bd1e-4fe1-8943-39498e0c2982/kube-rbac-proxy-main/0.log"
Jul 24 19:36:25.918371 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:25.918353    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pfzrg_e474248e-bd1e-4fe1-8943-39498e0c2982/kube-rbac-proxy-self/0.log"
Jul 24 19:36:26.120292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:26.120225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68c798f594-nz527_c20ccd3c-7a3d-4eac-a588-d13ec5ab7256/metrics-server/0.log"
Jul 24 19:36:26.318503 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:26.318480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-5lw6n_5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3/monitoring-plugin/0.log"
Jul 24 19:36:27.119162 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:27.119135    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czrv2_3b528eb1-3285-4a67-a437-a52327d06a26/init-textfile/0.log"
Jul 24 19:36:27.322156 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:27.322131    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czrv2_3b528eb1-3285-4a67-a437-a52327d06a26/node-exporter/0.log"
Jul 24 19:36:27.518657 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:27.518629    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czrv2_3b528eb1-3285-4a67-a437-a52327d06a26/kube-rbac-proxy/0.log"
Jul 24 19:36:28.318085 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:28.318061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-g4686_1f2b07d8-3625-4984-84bf-b2726da4844d/kube-rbac-proxy-main/0.log"
Jul 24 19:36:28.518570 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:28.518542    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-g4686_1f2b07d8-3625-4984-84bf-b2726da4844d/kube-rbac-proxy-self/0.log"
Jul 24 19:36:28.718141 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:28.718110    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-g4686_1f2b07d8-3625-4984-84bf-b2726da4844d/openshift-state-metrics/0.log"
Jul 24 19:36:28.918015 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:28.917991    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/init-config-reloader/0.log"
Jul 24 19:36:29.119482 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:29.119391    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/prometheus/0.log"
Jul 24 19:36:29.318885 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:29.318857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/config-reloader/0.log"
Jul 24 19:36:29.352124 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:29.352099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nwdnf"
Jul 24 19:36:29.519479 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:29.519426    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/thanos-sidecar/0.log"
Jul 24 19:36:29.719298 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:29.719274    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/kube-rbac-proxy-web/0.log"
Jul 24 19:36:29.918943 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:29.918919    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/kube-rbac-proxy/0.log"
Jul 24 19:36:30.119202 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:30.119171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/kube-rbac-proxy-thanos/0.log"
Jul 24 19:36:30.320136 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:30.320063    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-n2h2g_36dc8bc8-20a3-4e77-bdb3-cbc2d540124b/prometheus-operator/0.log"
Jul 24 19:36:30.518231 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:30.518202    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-n2h2g_36dc8bc8-20a3-4e77-bdb3-cbc2d540124b/kube-rbac-proxy/0.log"
Jul 24 19:36:30.718945 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:30.718923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-pqmq5_bda32a9a-eb45-4d36-9403-d16f79f5720d/prometheus-operator-admission-webhook/0.log"
Jul 24 19:36:30.918928 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:30.918903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/thanos-query/0.log"
Jul 24 19:36:31.118345 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:31.118288    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy-web/0.log"
Jul 24 19:36:31.318612 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:31.318592    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy/0.log"
Jul 24 19:36:31.518903 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:31.518883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/prom-label-proxy/0.log"
Jul 24 19:36:31.718859 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:31.718834    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy-rules/0.log"
Jul 24 19:36:31.918802 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:31.918783    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy-metrics/0.log"
Jul 24 19:36:32.363201 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:32.363115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:32.463048 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:32.463015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:32.718982 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:32.718948    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-798fc4b7dd-qz4pq_0e390ee6-f2ff-47bb-996b-e01e13edd69b/console/0.log"
Jul 24 19:36:32.919019 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:32.918995    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6499bf87-fszdk_7029cee0-e325-4fa1-8dd9-40cdcf90434a/console/0.log"
Jul 24 19:36:33.719196 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:33.719169    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nws7k_b2236125-f3ed-4308-b97f-0d34cbf2f348/serve-healthcheck-canary/0.log"
Jul 24 19:36:36.504831 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:36.504796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:36.557176 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:36.557112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:36:41.543470 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.543420    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-798fc4b7dd-qz4pq" podUID="0e390ee6-f2ff-47bb-996b-e01e13edd69b" containerName="console" containerID="cri-o://0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4" gracePeriod=15
Jul 24 19:36:41.783384 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.783363    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:36:41.846787 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846723    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-oauth-config\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.846931 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-serving-cert\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.846931 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-trusted-ca-bundle\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.846931 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846852    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-service-ca\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.846931 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846875    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-config\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.847122 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846930    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8knk\" (UniqueName: \"kubernetes.io/projected/0e390ee6-f2ff-47bb-996b-e01e13edd69b-kube-api-access-h8knk\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.847122 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.846958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-oauth-serving-cert\") pod \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\" (UID: \"0e390ee6-f2ff-47bb-996b-e01e13edd69b\") "
Jul 24 19:36:41.847340 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.847305    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:41.847340 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.847298    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:41.848214 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.848153    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:41.848214 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.847575    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-config" (OuterVolumeSpecName: "console-config") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:36:41.855885 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.855852    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:36:41.856026 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.855995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e390ee6-f2ff-47bb-996b-e01e13edd69b-kube-api-access-h8knk" (OuterVolumeSpecName: "kube-api-access-h8knk") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "kube-api-access-h8knk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:36:41.856087 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.856032    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e390ee6-f2ff-47bb-996b-e01e13edd69b" (UID: "0e390ee6-f2ff-47bb-996b-e01e13edd69b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:36:41.948318 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948291    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:41.948318 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948316    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:41.948318 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948324    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:41.948543 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948333    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:41.948543 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948343    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:41.948543 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948351    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8knk\" (UniqueName: \"kubernetes.io/projected/0e390ee6-f2ff-47bb-996b-e01e13edd69b-kube-api-access-h8knk\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:41.948543 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:41.948359    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e390ee6-f2ff-47bb-996b-e01e13edd69b-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:36:42.586561 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.586522    2560 generic.go:356] "Generic (PLEG): container finished" podID="0e390ee6-f2ff-47bb-996b-e01e13edd69b" containerID="0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4" exitCode=0
Jul 24 19:36:42.587036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.586588    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798fc4b7dd-qz4pq"
Jul 24 19:36:42.587036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.586606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fc4b7dd-qz4pq" event={"ID":"0e390ee6-f2ff-47bb-996b-e01e13edd69b","Type":"ContainerDied","Data":"0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4"}
Jul 24 19:36:42.587036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.586685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798fc4b7dd-qz4pq" event={"ID":"0e390ee6-f2ff-47bb-996b-e01e13edd69b","Type":"ContainerDied","Data":"4df50dfa6fb235ad13e926b8c3159f78262ad8c839e60ecc0804dd5c2031bb32"}
Jul 24 19:36:42.587036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.586707    2560 scope.go:117] "RemoveContainer" containerID="0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4"
Jul 24 19:36:42.594943 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.594928    2560 scope.go:117] "RemoveContainer" containerID="0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4"
Jul 24 19:36:42.595173 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:36:42.595154    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4\": container with ID starting with 0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4 not found: ID does not exist" containerID="0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4"
Jul 24 19:36:42.595221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.595181    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4"} err="failed to get container status \"0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4\": rpc error: code = NotFound desc = could not find container \"0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4\": container with ID starting with 0b18f40c8be1fb872a28067a3a79d0d993fc9f86cf8dcf73aae7b9bc5f2359f4 not found: ID does not exist"
Jul 24 19:36:42.607392 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.607368    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798fc4b7dd-qz4pq"]
Jul 24 19:36:42.610399 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.610379    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798fc4b7dd-qz4pq"]
Jul 24 19:36:42.841353 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:42.841276    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e390ee6-f2ff-47bb-996b-e01e13edd69b" path="/var/lib/kubelet/pods/0e390ee6-f2ff-47bb-996b-e01e13edd69b/volumes"
Jul 24 19:36:45.356428 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:45.356400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:36:45.360105 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:36:45.360082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68c798f594-nz527"
Jul 24 19:37:07.318181 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:07.318143    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:37:07.337702 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:07.337677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:37:07.698771 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:07.698742    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 19:37:08.072163 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:08.072084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:12.989187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:12.989155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:19.967025 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:19.966987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:20.768918 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:20.768879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:29.312688 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:29.312650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:29.364114 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:29.364085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:30.310895 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.310862    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-565559fb77-f8k67"]
Jul 24 19:37:30.311227 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.311213    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e390ee6-f2ff-47bb-996b-e01e13edd69b" containerName="console"
Jul 24 19:37:30.311227 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.311228    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e390ee6-f2ff-47bb-996b-e01e13edd69b" containerName="console"
Jul 24 19:37:30.311359 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.311237    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9053a124-2f35-4c74-a651-87794283043d" containerName="console"
Jul 24 19:37:30.311359 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.311242    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9053a124-2f35-4c74-a651-87794283043d" containerName="console"
Jul 24 19:37:30.311359 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.311294    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9053a124-2f35-4c74-a651-87794283043d" containerName="console"
Jul 24 19:37:30.311359 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.311303    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e390ee6-f2ff-47bb-996b-e01e13edd69b" containerName="console"
Jul 24 19:37:30.313869 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.313839    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.325227 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.325207    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-565559fb77-f8k67"]
Jul 24 19:37:30.354378 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-oauth-serving-cert\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.354378 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-oauth-config\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.354552 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-trusted-ca-bundle\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.354552 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-console-config\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.354660 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-serving-cert\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.354660 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6jt\" (UniqueName: \"kubernetes.io/projected/893dbe8e-6acc-46b0-849b-484b08680600-kube-api-access-nt6jt\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.354753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.354654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-service-ca\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.368642 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.368620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:30.455842 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.455809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-service-ca\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.456158 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.456140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-oauth-serving-cert\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.456381 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.456366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-oauth-config\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.456945 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.456926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-trusted-ca-bundle\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457092 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.457075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-console-config\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457636 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.456830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-service-ca\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457636 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.457191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-serving-cert\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457636 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.457253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6jt\" (UniqueName: \"kubernetes.io/projected/893dbe8e-6acc-46b0-849b-484b08680600-kube-api-access-nt6jt\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457636 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.457545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-oauth-serving-cert\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457898 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.457864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-trusted-ca-bundle\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.457898 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.457889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-console-config\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.459372 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.459354    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-oauth-config\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.459503 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.459487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-serving-cert\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.465656 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.465637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6jt\" (UniqueName: \"kubernetes.io/projected/893dbe8e-6acc-46b0-849b-484b08680600-kube-api-access-nt6jt\") pod \"console-565559fb77-f8k67\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") " pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.469062 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.468977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:30.569727 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.569620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:30.626240 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.626209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:30.748816 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.748791    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-565559fb77-f8k67"]
Jul 24 19:37:30.751346 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:37:30.751319    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893dbe8e_6acc_46b0_849b_484b08680600.slice/crio-8c9beacf54e4afcf80bc601208a710f5f73fa03bdacf892e28c8cafccdda0eab WatchSource:0}: Error finding container 8c9beacf54e4afcf80bc601208a710f5f73fa03bdacf892e28c8cafccdda0eab: Status 404 returned error can't find the container with id 8c9beacf54e4afcf80bc601208a710f5f73fa03bdacf892e28c8cafccdda0eab
Jul 24 19:37:30.770528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:30.770501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565559fb77-f8k67" event={"ID":"893dbe8e-6acc-46b0-849b-484b08680600","Type":"ContainerStarted","Data":"8c9beacf54e4afcf80bc601208a710f5f73fa03bdacf892e28c8cafccdda0eab"}
Jul 24 19:37:31.114978 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:31.114945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:31.775369 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:31.775329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565559fb77-f8k67" event={"ID":"893dbe8e-6acc-46b0-849b-484b08680600","Type":"ContainerStarted","Data":"8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664"}
Jul 24 19:37:31.791893 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:31.791838    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-565559fb77-f8k67" podStartSLOduration=1.7918202989999998 podStartE2EDuration="1.791820299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:37:31.791302033 +0000 UTC m=+165.435565093" watchObservedRunningTime="2026-07-24 19:37:31.791820299 +0000 UTC m=+165.436083340"
Jul 24 19:37:35.193200 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:35.193163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:35.294169 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:35.294139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:40.626842 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.626756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:40.626842 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.626822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:40.631776 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.631754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:40.814453 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.814425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:37:40.859013 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.858985    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6499bf87-fszdk"]
Jul 24 19:37:40.924245 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.924216    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f88d7b6b7-bl8zv"]
Jul 24 19:37:40.926475 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.926439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:40.936873 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:40.936847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f88d7b6b7-bl8zv"]
Jul 24 19:37:41.057702 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e29002-927e-4766-a975-b102a6ceb495-console-oauth-config\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.057702 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-trusted-ca-bundle\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.057972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-console-config\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.057972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e29002-927e-4766-a975-b102a6ceb495-console-serving-cert\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.057972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kktzp\" (UniqueName: \"kubernetes.io/projected/a6e29002-927e-4766-a975-b102a6ceb495-kube-api-access-kktzp\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.057972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-service-ca\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.057972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.057907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-oauth-serving-cert\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.158711 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.158676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-console-config\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.158851 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.158727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e29002-927e-4766-a975-b102a6ceb495-console-serving-cert\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.158906 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.158849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kktzp\" (UniqueName: \"kubernetes.io/projected/a6e29002-927e-4766-a975-b102a6ceb495-kube-api-access-kktzp\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.158906 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.158898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-service-ca\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159007 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.158943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-oauth-serving-cert\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159007 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.158992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e29002-927e-4766-a975-b102a6ceb495-console-oauth-config\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159100 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.159037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-trusted-ca-bundle\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159441 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.159416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-console-config\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159571 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.159561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-service-ca\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159706 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.159678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-oauth-serving-cert\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.159902 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.159884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e29002-927e-4766-a975-b102a6ceb495-trusted-ca-bundle\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.161323 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.161305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e29002-927e-4766-a975-b102a6ceb495-console-serving-cert\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.161706 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.161691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e29002-927e-4766-a975-b102a6ceb495-console-oauth-config\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.166883 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.166866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kktzp\" (UniqueName: \"kubernetes.io/projected/a6e29002-927e-4766-a975-b102a6ceb495-kube-api-access-kktzp\") pod \"console-7f88d7b6b7-bl8zv\" (UID: \"a6e29002-927e-4766-a975-b102a6ceb495\") " pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.219318 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.219246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:41.236263 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.236230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:41.268075 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.268033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:41.366245 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:37:41.366216    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e29002_927e_4766_a975_b102a6ceb495.slice/crio-47c747014f0dc5bc0e3c80f65d0d67e5f048dd608d0156640938913e5c0dd05e WatchSource:0}: Error finding container 47c747014f0dc5bc0e3c80f65d0d67e5f048dd608d0156640938913e5c0dd05e: Status 404 returned error can't find the container with id 47c747014f0dc5bc0e3c80f65d0d67e5f048dd608d0156640938913e5c0dd05e
Jul 24 19:37:41.372738 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.372711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f88d7b6b7-bl8zv"]
Jul 24 19:37:41.816137 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.816099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88d7b6b7-bl8zv" event={"ID":"a6e29002-927e-4766-a975-b102a6ceb495","Type":"ContainerStarted","Data":"c9932881ae226f7458d54dc3030e81a902923cc7bd92c1a83585c22cc0cc72a7"}
Jul 24 19:37:41.816555 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.816177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88d7b6b7-bl8zv" event={"ID":"a6e29002-927e-4766-a975-b102a6ceb495","Type":"ContainerStarted","Data":"47c747014f0dc5bc0e3c80f65d0d67e5f048dd608d0156640938913e5c0dd05e"}
Jul 24 19:37:41.835363 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:41.835300    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f88d7b6b7-bl8zv" podStartSLOduration=1.8352788370000002 podStartE2EDuration="1.835278837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:37:41.832189326 +0000 UTC m=+175.476452366" watchObservedRunningTime="2026-07-24 19:37:41.835278837 +0000 UTC m=+175.479541878"
Jul 24 19:37:43.564509 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:43.564452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:43.665418 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:43.665391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:43.765699 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:43.765658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:51.236823 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.236787    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:51.237317 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.236840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:51.241630 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.241601    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:51.504080 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.503987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:51.556775 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.556745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:51.857270 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.857184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f88d7b6b7-bl8zv"
Jul 24 19:37:51.907417 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:51.907388    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-565559fb77-f8k67"]
Jul 24 19:37:52.002591 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:52.002559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:52.103669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:52.103634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:52.156541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:52.156448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:53.118770 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:53.118736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:37:53.170965 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:37:53.170935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:01.074161 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:01.074131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:01.125061 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:01.125038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:05.879756 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:05.879692    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c6499bf87-fszdk" podUID="7029cee0-e325-4fa1-8dd9-40cdcf90434a" containerName="console" containerID="cri-o://716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e" gracePeriod=15
Jul 24 19:38:06.121765 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.121740    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:38:06.170539 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170510    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-trusted-ca-bundle\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170545    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-config\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170585    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-serving-cert\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170790 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170695    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t42hb\" (UniqueName: \"kubernetes.io/projected/7029cee0-e325-4fa1-8dd9-40cdcf90434a-kube-api-access-t42hb\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170790 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-oauth-serving-cert\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170790 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170776    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-oauth-config\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170841    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-service-ca\") pod \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\" (UID: \"7029cee0-e325-4fa1-8dd9-40cdcf90434a\") "
Jul 24 19:38:06.170937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.170925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:06.171108 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.171062    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-config" (OuterVolumeSpecName: "console-config") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:06.171222 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.171145    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.171222 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.171144    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:06.171300 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.171231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-service-ca" (OuterVolumeSpecName: "service-ca") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:06.172811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.172791    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:38:06.172882 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.172816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:38:06.172922 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.172901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7029cee0-e325-4fa1-8dd9-40cdcf90434a-kube-api-access-t42hb" (OuterVolumeSpecName: "kube-api-access-t42hb") pod "7029cee0-e325-4fa1-8dd9-40cdcf90434a" (UID: "7029cee0-e325-4fa1-8dd9-40cdcf90434a"). InnerVolumeSpecName "kube-api-access-t42hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:38:06.272528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.272502    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.272528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.272521    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t42hb\" (UniqueName: \"kubernetes.io/projected/7029cee0-e325-4fa1-8dd9-40cdcf90434a-kube-api-access-t42hb\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.272528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.272531    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.272703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.272540    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.272703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.272550    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.272703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.272558    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7029cee0-e325-4fa1-8dd9-40cdcf90434a-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:06.911546 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.911516    2560 generic.go:356] "Generic (PLEG): container finished" podID="7029cee0-e325-4fa1-8dd9-40cdcf90434a" containerID="716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e" exitCode=0
Jul 24 19:38:06.911924 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.911557    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6499bf87-fszdk"
Jul 24 19:38:06.911924 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.911576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6499bf87-fszdk" event={"ID":"7029cee0-e325-4fa1-8dd9-40cdcf90434a","Type":"ContainerDied","Data":"716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e"}
Jul 24 19:38:06.911924 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.911615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6499bf87-fszdk" event={"ID":"7029cee0-e325-4fa1-8dd9-40cdcf90434a","Type":"ContainerDied","Data":"29fdd4f44d7cdd769f56142dcf62843e6a443bb3b09e55074dedf09b5d00efee"}
Jul 24 19:38:06.911924 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.911639    2560 scope.go:117] "RemoveContainer" containerID="716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e"
Jul 24 19:38:06.919525 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.919492    2560 scope.go:117] "RemoveContainer" containerID="716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e"
Jul 24 19:38:06.919760 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:38:06.919739    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e\": container with ID starting with 716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e not found: ID does not exist" containerID="716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e"
Jul 24 19:38:06.919812 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.919768    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e"} err="failed to get container status \"716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e\": rpc error: code = NotFound desc = could not find container \"716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e\": container with ID starting with 716b8ac52ea88aa75d9dc81eb8916d14568e1213e50f119215e8ef8972fab16e not found: ID does not exist"
Jul 24 19:38:06.928265 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.928246    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6499bf87-fszdk"]
Jul 24 19:38:06.932254 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:06.932233    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6499bf87-fszdk"]
Jul 24 19:38:08.842355 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:08.842317    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7029cee0-e325-4fa1-8dd9-40cdcf90434a" path="/var/lib/kubelet/pods/7029cee0-e325-4fa1-8dd9-40cdcf90434a/volumes"
Jul 24 19:38:10.515152 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:10.515116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:16.927272 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:16.927228    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-565559fb77-f8k67" podUID="893dbe8e-6acc-46b0-849b-484b08680600" containerName="console" containerID="cri-o://8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664" gracePeriod=15
Jul 24 19:38:17.168065 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.168041    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:38:17.258646 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-oauth-config\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.258646 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258606    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-oauth-serving-cert\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.258861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258657    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt6jt\" (UniqueName: \"kubernetes.io/projected/893dbe8e-6acc-46b0-849b-484b08680600-kube-api-access-nt6jt\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.258861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258681    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-service-ca\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.258861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258698    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-console-config\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.258861 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-serving-cert\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.259048 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.258875    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-trusted-ca-bundle\") pod \"893dbe8e-6acc-46b0-849b-484b08680600\" (UID: \"893dbe8e-6acc-46b0-849b-484b08680600\") "
Jul 24 19:38:17.259093 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:17.259164 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259087    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-console-config" (OuterVolumeSpecName: "console-config") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:17.259164 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259106    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-service-ca" (OuterVolumeSpecName: "service-ca") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:17.259336 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259219    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.259501 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259344    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.259501 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259360    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.259501 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.259435    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:38:17.260888 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.260868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:38:17.261169 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.261150    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:38:17.261277 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.261262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893dbe8e-6acc-46b0-849b-484b08680600-kube-api-access-nt6jt" (OuterVolumeSpecName: "kube-api-access-nt6jt") pod "893dbe8e-6acc-46b0-849b-484b08680600" (UID: "893dbe8e-6acc-46b0-849b-484b08680600"). InnerVolumeSpecName "kube-api-access-nt6jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:38:17.360725 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.360695    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6jt\" (UniqueName: \"kubernetes.io/projected/893dbe8e-6acc-46b0-849b-484b08680600-kube-api-access-nt6jt\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.360725 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.360728    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.360909 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.360742    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/893dbe8e-6acc-46b0-849b-484b08680600-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.360909 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.360755    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893dbe8e-6acc-46b0-849b-484b08680600-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:38:17.957264 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.957226    2560 generic.go:356] "Generic (PLEG): container finished" podID="893dbe8e-6acc-46b0-849b-484b08680600" containerID="8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664" exitCode=0
Jul 24 19:38:17.957728 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.957274    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-565559fb77-f8k67"
Jul 24 19:38:17.957728 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.957316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565559fb77-f8k67" event={"ID":"893dbe8e-6acc-46b0-849b-484b08680600","Type":"ContainerDied","Data":"8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664"}
Jul 24 19:38:17.957728 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.957369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-565559fb77-f8k67" event={"ID":"893dbe8e-6acc-46b0-849b-484b08680600","Type":"ContainerDied","Data":"8c9beacf54e4afcf80bc601208a710f5f73fa03bdacf892e28c8cafccdda0eab"}
Jul 24 19:38:17.957728 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.957389    2560 scope.go:117] "RemoveContainer" containerID="8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664"
Jul 24 19:38:17.966163 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.966145    2560 scope.go:117] "RemoveContainer" containerID="8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664"
Jul 24 19:38:17.966394 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:38:17.966376    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664\": container with ID starting with 8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664 not found: ID does not exist" containerID="8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664"
Jul 24 19:38:17.966434 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.966402    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664"} err="failed to get container status \"8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664\": rpc error: code = NotFound desc = could not find container \"8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664\": container with ID starting with 8ef897fa32433b7506cdcfb4066c7099753f824ed4c5c9353570b39d90d01664 not found: ID does not exist"
Jul 24 19:38:17.977837 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.977817    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-565559fb77-f8k67"]
Jul 24 19:38:17.981507 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:17.981477    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-565559fb77-f8k67"]
Jul 24 19:38:18.841437 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:18.841403    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893dbe8e-6acc-46b0-849b-484b08680600" path="/var/lib/kubelet/pods/893dbe8e-6acc-46b0-849b-484b08680600/volumes"
Jul 24 19:38:21.523845 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:21.523811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:21.624708 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:21.624680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:55.811329 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:55.811288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:38:55.911957 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:38:55.911913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:22.398606 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:22.398572    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:23.218893 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:23.218858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:26.039440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:26.039406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:26.141145 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:26.141109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:27.275887 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:27.275854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:27.376230 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:27.376191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:28.044572 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:28.044530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:28.122090 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:28.122049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:30.045972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.045941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:30.332865 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.332793    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gvhbw"]
Jul 24 19:39:30.333113 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.333102    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893dbe8e-6acc-46b0-849b-484b08680600" containerName="console"
Jul 24 19:39:30.333160 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.333115    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="893dbe8e-6acc-46b0-849b-484b08680600" containerName="console"
Jul 24 19:39:30.333160 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.333123    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7029cee0-e325-4fa1-8dd9-40cdcf90434a" containerName="console"
Jul 24 19:39:30.333160 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.333129    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7029cee0-e325-4fa1-8dd9-40cdcf90434a" containerName="console"
Jul 24 19:39:30.333253 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.333189    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7029cee0-e325-4fa1-8dd9-40cdcf90434a" containerName="console"
Jul 24 19:39:30.333253 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.333195    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="893dbe8e-6acc-46b0-849b-484b08680600" containerName="console"
Jul 24 19:39:30.336060 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.336043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.338428 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.338411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 19:39:30.338531 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.338442    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wmnjg\""
Jul 24 19:39:30.339517 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.339504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 19:39:30.343397 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.343376    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gvhbw"]
Jul 24 19:39:30.425353 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.425320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dwjj\" (UniqueName: \"kubernetes.io/projected/d7d1229b-1e19-458b-bb52-9e1d6a7bedcb-kube-api-access-8dwjj\") pod \"cert-manager-webhook-6486ffd997-gvhbw\" (UID: \"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.425353 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.425356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7d1229b-1e19-458b-bb52-9e1d6a7bedcb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gvhbw\" (UID: \"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.433649 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.433623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:30.526579 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.526538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7d1229b-1e19-458b-bb52-9e1d6a7bedcb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gvhbw\" (UID: \"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.526772 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.526673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dwjj\" (UniqueName: \"kubernetes.io/projected/d7d1229b-1e19-458b-bb52-9e1d6a7bedcb-kube-api-access-8dwjj\") pod \"cert-manager-webhook-6486ffd997-gvhbw\" (UID: \"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.534573 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.534555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7d1229b-1e19-458b-bb52-9e1d6a7bedcb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gvhbw\" (UID: \"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.534793 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.534773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dwjj\" (UniqueName: \"kubernetes.io/projected/d7d1229b-1e19-458b-bb52-9e1d6a7bedcb-kube-api-access-8dwjj\") pod \"cert-manager-webhook-6486ffd997-gvhbw\" (UID: \"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.655965 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.655864    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:30.783225 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:30.783197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gvhbw"]
Jul 24 19:39:30.785691 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:39:30.785663    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7d1229b_1e19_458b_bb52_9e1d6a7bedcb.slice/crio-b9ee8ab33b1565db9dafd0bdf5ae199165f976d00b9d8f9f810fba48cf76691d WatchSource:0}: Error finding container b9ee8ab33b1565db9dafd0bdf5ae199165f976d00b9d8f9f810fba48cf76691d: Status 404 returned error can't find the container with id b9ee8ab33b1565db9dafd0bdf5ae199165f976d00b9d8f9f810fba48cf76691d
Jul 24 19:39:31.243785 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:31.243753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw" event={"ID":"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb","Type":"ContainerStarted","Data":"b9ee8ab33b1565db9dafd0bdf5ae199165f976d00b9d8f9f810fba48cf76691d"}
Jul 24 19:39:32.805480 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:32.805429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:34.074003 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:34.073974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:34.259133 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:34.259101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw" event={"ID":"d7d1229b-1e19-458b-bb52-9e1d6a7bedcb","Type":"ContainerStarted","Data":"091293a0634959ddeb6c2f2e1e801c260bdcd1bca91ebc5a232b5f8fb47b8fe4"}
Jul 24 19:39:34.259282 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:34.259154    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:34.275196 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:34.275150    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw" podStartSLOduration=1.219940814 podStartE2EDuration="4.275138341s" totalImagesPullingTime="3.055197527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:34.273747076 +0000 UTC m=+287.918010116" watchObservedRunningTime="2026-07-24 19:39:34.275138341 +0000 UTC m=+287.919401380"
Jul 24 19:39:34.487826 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:34.487794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:34.574277 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:34.574206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:36.411877 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:36.411844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:36.513405 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:36.513375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:38.442271 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.442240    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"]
Jul 24 19:39:38.445349 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.445332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.447789 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.447767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h7rqc\""
Jul 24 19:39:38.447789 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.447784    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 19:39:38.449072 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.449055    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 19:39:38.452883 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.452863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"]
Jul 24 19:39:38.497141 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.497114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f6c2d88-f2da-466e-adf0-6b91080043ea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8dt9k\" (UID: \"7f6c2d88-f2da-466e-adf0-6b91080043ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.497231 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.497146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdzb\" (UniqueName: \"kubernetes.io/projected/7f6c2d88-f2da-466e-adf0-6b91080043ea-kube-api-access-8kdzb\") pod \"openshift-lws-operator-fd8ccff4c-8dt9k\" (UID: \"7f6c2d88-f2da-466e-adf0-6b91080043ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.598410 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.598382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f6c2d88-f2da-466e-adf0-6b91080043ea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8dt9k\" (UID: \"7f6c2d88-f2da-466e-adf0-6b91080043ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.598528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.598418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdzb\" (UniqueName: \"kubernetes.io/projected/7f6c2d88-f2da-466e-adf0-6b91080043ea-kube-api-access-8kdzb\") pod \"openshift-lws-operator-fd8ccff4c-8dt9k\" (UID: \"7f6c2d88-f2da-466e-adf0-6b91080043ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.598752 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.598736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f6c2d88-f2da-466e-adf0-6b91080043ea-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8dt9k\" (UID: \"7f6c2d88-f2da-466e-adf0-6b91080043ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.607634 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.607612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdzb\" (UniqueName: \"kubernetes.io/projected/7f6c2d88-f2da-466e-adf0-6b91080043ea-kube-api-access-8kdzb\") pod \"openshift-lws-operator-fd8ccff4c-8dt9k\" (UID: \"7f6c2d88-f2da-466e-adf0-6b91080043ea\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.647221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.647198    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:38.754378 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.754301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"
Jul 24 19:39:38.880630 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:38.880608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k"]
Jul 24 19:39:38.883091 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:39:38.883066    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f6c2d88_f2da_466e_adf0_6b91080043ea.slice/crio-8b8fcf4496ed7219c2ffe7f4568655aa0d0da7061878e1673d50d29e10cc488c WatchSource:0}: Error finding container 8b8fcf4496ed7219c2ffe7f4568655aa0d0da7061878e1673d50d29e10cc488c: Status 404 returned error can't find the container with id 8b8fcf4496ed7219c2ffe7f4568655aa0d0da7061878e1673d50d29e10cc488c
Jul 24 19:39:39.281979 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:39.281944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k" event={"ID":"7f6c2d88-f2da-466e-adf0-6b91080043ea","Type":"ContainerStarted","Data":"8b8fcf4496ed7219c2ffe7f4568655aa0d0da7061878e1673d50d29e10cc488c"}
Jul 24 19:39:40.266138 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:40.266112    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gvhbw"
Jul 24 19:39:42.297531 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:42.297497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k" event={"ID":"7f6c2d88-f2da-466e-adf0-6b91080043ea","Type":"ContainerStarted","Data":"746f2b6f2acdeefe8c67a09f36387cb61bba79b961933b95559f5159303f52f6"}
Jul 24 19:39:42.313645 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:42.313596    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8dt9k" podStartSLOduration=1.550024931 podStartE2EDuration="4.313580526s" totalImagesPullingTime="2.763555595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:39:42.312676983 +0000 UTC m=+295.956940023" watchObservedRunningTime="2026-07-24 19:39:42.313580526 +0000 UTC m=+295.957843564"
Jul 24 19:39:42.992098 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:42.992061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:43.097231 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:43.097200    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:45.201914 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:45.201883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:39:46.732106 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:39:46.732081    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 19:40:01.414121 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.414084    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:01.472578 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.472545    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"]
Jul 24 19:40:01.474650 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.474635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.477369 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.477339    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 19:40:01.477507 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.477377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 19:40:01.478534 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.478515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 19:40:01.478620 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.478552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fsmlx\""
Jul 24 19:40:01.494114 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.494094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"]
Jul 24 19:40:01.497407 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.497392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5a8553e-8143-428c-b80b-18ed2dde25ac-cert\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.497514 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.497431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzks\" (UniqueName: \"kubernetes.io/projected/e5a8553e-8143-428c-b80b-18ed2dde25ac-kube-api-access-6vzks\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.497514 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.497472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e5a8553e-8143-428c-b80b-18ed2dde25ac-manager-config\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.497604 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.497567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5a8553e-8143-428c-b80b-18ed2dde25ac-metrics-cert\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.511187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.511167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:01.598597 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.598563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5a8553e-8143-428c-b80b-18ed2dde25ac-cert\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.598773 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.598628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzks\" (UniqueName: \"kubernetes.io/projected/e5a8553e-8143-428c-b80b-18ed2dde25ac-kube-api-access-6vzks\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.598773 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.598659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e5a8553e-8143-428c-b80b-18ed2dde25ac-manager-config\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.598773 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.598700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5a8553e-8143-428c-b80b-18ed2dde25ac-metrics-cert\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.599350 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.599330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e5a8553e-8143-428c-b80b-18ed2dde25ac-manager-config\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.601187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.601164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5a8553e-8143-428c-b80b-18ed2dde25ac-metrics-cert\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.601187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.601180    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5a8553e-8143-428c-b80b-18ed2dde25ac-cert\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.618707 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.618679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzks\" (UniqueName: \"kubernetes.io/projected/e5a8553e-8143-428c-b80b-18ed2dde25ac-kube-api-access-6vzks\") pod \"lws-controller-manager-6c7b4484d8-mgdw8\" (UID: \"e5a8553e-8143-428c-b80b-18ed2dde25ac\") " pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.784088 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.783989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:01.917202 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.917172    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"]
Jul 24 19:40:01.920140 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:40:01.920114    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a8553e_8143_428c_b80b_18ed2dde25ac.slice/crio-96d05cb8f47a7a435f09bd6408e512547c43691fd6643e907e2783eb22bcda42 WatchSource:0}: Error finding container 96d05cb8f47a7a435f09bd6408e512547c43691fd6643e907e2783eb22bcda42: Status 404 returned error can't find the container with id 96d05cb8f47a7a435f09bd6408e512547c43691fd6643e907e2783eb22bcda42
Jul 24 19:40:01.922042 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:01.922027    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:40:02.071652 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:02.071554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:02.208541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:02.208505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:02.385840 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:02.385738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8" event={"ID":"e5a8553e-8143-428c-b80b-18ed2dde25ac","Type":"ContainerStarted","Data":"96d05cb8f47a7a435f09bd6408e512547c43691fd6643e907e2783eb22bcda42"}
Jul 24 19:40:02.640701 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:02.640614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:02.911195 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:02.911163    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.021683 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.021650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.059357 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.059321    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"]
Jul 24 19:40:03.062255 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.062234    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.065101 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.065075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 19:40:03.065230 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.065120    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 19:40:03.065230 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.065125    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 19:40:03.065369 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.065239    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2ws7w\""
Jul 24 19:40:03.065411 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.065365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 19:40:03.082665 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.082630    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"]
Jul 24 19:40:03.115057 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.115024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1582e040-13e1-4387-885b-2c869ae21097-tmp\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.115240 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.115077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kspln\" (UniqueName: \"kubernetes.io/projected/1582e040-13e1-4387-885b-2c869ae21097-kube-api-access-kspln\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.115240 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.115143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1582e040-13e1-4387-885b-2c869ae21097-webhook-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.115319 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.115263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1582e040-13e1-4387-885b-2c869ae21097-manifests\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.115319 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.115296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1582e040-13e1-4387-885b-2c869ae21097-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.180245 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.180162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.216045 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.215997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1582e040-13e1-4387-885b-2c869ae21097-manifests\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.216208 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.216187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1582e040-13e1-4387-885b-2c869ae21097-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.216278 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.216226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1582e040-13e1-4387-885b-2c869ae21097-tmp\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.216334 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.216290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kspln\" (UniqueName: \"kubernetes.io/projected/1582e040-13e1-4387-885b-2c869ae21097-kube-api-access-kspln\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.216394 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.216338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1582e040-13e1-4387-885b-2c869ae21097-webhook-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.216518 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.216492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1582e040-13e1-4387-885b-2c869ae21097-manifests\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.219693 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.219632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1582e040-13e1-4387-885b-2c869ae21097-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.219693 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.219633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1582e040-13e1-4387-885b-2c869ae21097-webhook-cert\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.219874 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.219806    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1582e040-13e1-4387-885b-2c869ae21097-tmp\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.229776 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.229714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kspln\" (UniqueName: \"kubernetes.io/projected/1582e040-13e1-4387-885b-2c869ae21097-kube-api-access-kspln\") pod \"opendatahub-operator-controller-manager-d7d8f86c4-cvgbd\" (UID: \"1582e040-13e1-4387-885b-2c869ae21097\") " pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.282167 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.282127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.372421 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.372375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:03.390640 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.390613    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.497903 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.497863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.523493 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.523413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"]
Jul 24 19:40:03.528092 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:40:03.528061    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1582e040_13e1_4387_885b_2c869ae21097.slice/crio-5c84433e68ef3febf4f90c11a3f37fca20fe442a418d000b1558e3f3564ed264 WatchSource:0}: Error finding container 5c84433e68ef3febf4f90c11a3f37fca20fe442a418d000b1558e3f3564ed264: Status 404 returned error can't find the container with id 5c84433e68ef3febf4f90c11a3f37fca20fe442a418d000b1558e3f3564ed264
Jul 24 19:40:03.601904 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.601870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:03.698032 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:03.697985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:04.397453 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:04.397408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd" event={"ID":"1582e040-13e1-4387-885b-2c869ae21097","Type":"ContainerStarted","Data":"5c84433e68ef3febf4f90c11a3f37fca20fe442a418d000b1558e3f3564ed264"}
Jul 24 19:40:07.416537 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:07.416498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd" event={"ID":"1582e040-13e1-4387-885b-2c869ae21097","Type":"ContainerStarted","Data":"2a27dfab588ad563578eccbf88d08f60361b9cb519a711cb2797d467072694d2"}
Jul 24 19:40:08.422649 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:08.422606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8" event={"ID":"e5a8553e-8143-428c-b80b-18ed2dde25ac","Type":"ContainerStarted","Data":"b6455ed842a61ac14e0a4798d25734a157d37a6c3109493ada23aff14bcad5e4"}
Jul 24 19:40:08.423062 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:08.422752    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:08.424141 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:08.424107    2560 generic.go:356] "Generic (PLEG): container finished" podID="1582e040-13e1-4387-885b-2c869ae21097" containerID="2a27dfab588ad563578eccbf88d08f60361b9cb519a711cb2797d467072694d2" exitCode=0
Jul 24 19:40:08.424261 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:08.424177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd" event={"ID":"1582e040-13e1-4387-885b-2c869ae21097","Type":"ContainerDied","Data":"2a27dfab588ad563578eccbf88d08f60361b9cb519a711cb2797d467072694d2"}
Jul 24 19:40:08.438984 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:08.438946    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8" podStartSLOduration=1.888236636 podStartE2EDuration="7.438931506s" totalImagesPullingTime="5.55069487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:08.437154852 +0000 UTC m=+322.081417893" watchObservedRunningTime="2026-07-24 19:40:08.438931506 +0000 UTC m=+322.083194599"
Jul 24 19:40:09.432494 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:09.432437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd" event={"ID":"1582e040-13e1-4387-885b-2c869ae21097","Type":"ContainerStarted","Data":"b727e4d4a27af835fa0717731246a0a40325ee91d258369d7adbd0a31c0b9253"}
Jul 24 19:40:09.453870 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:09.453825    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd" podStartSLOduration=1.6910082100000001 podStartE2EDuration="6.453811164s" totalImagesPullingTime="3.535320862s" totalInitContainerRuntime="1.227482092s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:09.452088025 +0000 UTC m=+323.096351065" watchObservedRunningTime="2026-07-24 19:40:09.453811164 +0000 UTC m=+323.098074203"
Jul 24 19:40:10.436841 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:10.436808    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:19.435135 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:19.435104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c7b4484d8-mgdw8"
Jul 24 19:40:21.443653 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:21.443625    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d7d8f86c4-cvgbd"
Jul 24 19:40:23.089546 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:23.089510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:23.219989 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:23.219955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:28.964068 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:28.964010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:29.009272 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.009242    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"]
Jul 24 19:40:29.017752 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.017726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.020514 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.020438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 19:40:29.021757 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.021608    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 19:40:29.021757 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.021614    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 19:40:29.022690 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.022667    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-86bd7\""
Jul 24 19:40:29.022805 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.022752    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 19:40:29.023402 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.023382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"]
Jul 24 19:40:29.107318 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.107279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:29.128653 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.128629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ace8df7-6ceb-4ade-829b-12c2a701a54e-tls-certs\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.128763 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.128659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvhh\" (UniqueName: \"kubernetes.io/projected/9ace8df7-6ceb-4ade-829b-12c2a701a54e-kube-api-access-gmvhh\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.128763 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.128684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ace8df7-6ceb-4ade-829b-12c2a701a54e-tmp\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.214410 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.214349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:29.229096 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.229076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ace8df7-6ceb-4ade-829b-12c2a701a54e-tls-certs\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.229198 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.229107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvhh\" (UniqueName: \"kubernetes.io/projected/9ace8df7-6ceb-4ade-829b-12c2a701a54e-kube-api-access-gmvhh\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.229198 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.229130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ace8df7-6ceb-4ade-829b-12c2a701a54e-tmp\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.231334 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.231314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ace8df7-6ceb-4ade-829b-12c2a701a54e-tmp\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.231668 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.231649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ace8df7-6ceb-4ade-829b-12c2a701a54e-tls-certs\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.239155 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.239128    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvhh\" (UniqueName: \"kubernetes.io/projected/9ace8df7-6ceb-4ade-829b-12c2a701a54e-kube-api-access-gmvhh\") pod \"kube-auth-proxy-85c49bfc89-fbdkz\" (UID: \"9ace8df7-6ceb-4ade-829b-12c2a701a54e\") " pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.304402 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.304373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:29.328570 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.328547    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"
Jul 24 19:40:29.453428 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.453406    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz"]
Jul 24 19:40:29.455845 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:40:29.455816    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ace8df7_6ceb_4ade_829b_12c2a701a54e.slice/crio-d359e30a9438645597238db188b8ce0cf10b39adfbce1c17cb0f22a9b6b94862 WatchSource:0}: Error finding container d359e30a9438645597238db188b8ce0cf10b39adfbce1c17cb0f22a9b6b94862: Status 404 returned error can't find the container with id d359e30a9438645597238db188b8ce0cf10b39adfbce1c17cb0f22a9b6b94862
Jul 24 19:40:29.522885 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.522826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz" event={"ID":"9ace8df7-6ceb-4ade-829b-12c2a701a54e","Type":"ContainerStarted","Data":"d359e30a9438645597238db188b8ce0cf10b39adfbce1c17cb0f22a9b6b94862"}
Jul 24 19:40:29.626384 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.626355    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:29.737636 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.737600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:29.841040 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:29.840977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:30.091281 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:30.091203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:30.154927 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:30.154894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:31.005035 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:31.004998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:32.538867 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:32.538836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz" event={"ID":"9ace8df7-6ceb-4ade-829b-12c2a701a54e","Type":"ContainerStarted","Data":"37ce7ae42823527929a00822bc73f935ce66126d2620d4ea14d0bebc9d13bcbe"}
Jul 24 19:40:32.556410 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:32.556365    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85c49bfc89-fbdkz" podStartSLOduration=2.074549475 podStartE2EDuration="4.556352451s" totalImagesPullingTime="2.481802976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:40:32.555262541 +0000 UTC m=+346.199525603" watchObservedRunningTime="2026-07-24 19:40:32.556352451 +0000 UTC m=+346.200615491"
Jul 24 19:40:36.480539 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:36.480506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:36.586785 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:36.586753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:37.255894 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:37.255864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:37.411002 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:37.410972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:37.507641 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:37.507567    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:40.185836 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:40.185734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:40.335978 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:40.335945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:40.538203 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:40.538123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:40.635328 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:40.635293    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:40.748594 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:40.748565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:44.775153 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:44.775120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:40:44.875656 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:40:44.875626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:16.220073 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:16.220036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:16.272829 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:16.272789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:24.540537 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:24.540507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:24.642858 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:24.642827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:24.740052 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:24.740028    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:53.407786 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:53.407753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:56.956289 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:56.956252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:41:59.974210 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:41:59.974179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:01.441192 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:01.441157    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:01.741995 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:01.741907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:02.366771 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:02.366739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:04.809890 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:04.809857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:05.741821 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:05.741780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:07.659195 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:07.659164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:09.153189 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:09.153115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:09.254926 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:09.254888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:11.098776 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.098743    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"]
Jul 24 19:42:11.102065 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.102043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.102065 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.102058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:11.104587 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.104563    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 24 19:42:11.104962 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.104947    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 24 19:42:11.105058 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.105016    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 19:42:11.105633 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.105615    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 19:42:11.105718 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.105622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tf6ws\""
Jul 24 19:42:11.109634 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.109614    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"]
Jul 24 19:42:11.159877 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.159845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zjq\" (UniqueName: \"kubernetes.io/projected/83feb7e3-7f2f-40d5-a1dc-a073049c2191-kube-api-access-w4zjq\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.160010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.159882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83feb7e3-7f2f-40d5-a1dc-a073049c2191-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.160010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.159923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83feb7e3-7f2f-40d5-a1dc-a073049c2191-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.260856 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.260823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83feb7e3-7f2f-40d5-a1dc-a073049c2191-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.261008 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.260874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83feb7e3-7f2f-40d5-a1dc-a073049c2191-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.261008 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.260928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zjq\" (UniqueName: \"kubernetes.io/projected/83feb7e3-7f2f-40d5-a1dc-a073049c2191-kube-api-access-w4zjq\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.261008 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:42:11.260975    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 24 19:42:11.261121 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:42:11.261059    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83feb7e3-7f2f-40d5-a1dc-a073049c2191-plugin-serving-cert podName:83feb7e3-7f2f-40d5-a1dc-a073049c2191 nodeName:}" failed. No retries permitted until 2026-07-24 19:42:11.761038456 +0000 UTC m=+445.405301490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/83feb7e3-7f2f-40d5-a1dc-a073049c2191-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9wfrs" (UID: "83feb7e3-7f2f-40d5-a1dc-a073049c2191") : secret "plugin-serving-cert" not found
Jul 24 19:42:11.261597 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.261580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83feb7e3-7f2f-40d5-a1dc-a073049c2191-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.270952 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.270931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zjq\" (UniqueName: \"kubernetes.io/projected/83feb7e3-7f2f-40d5-a1dc-a073049c2191-kube-api-access-w4zjq\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.376227 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.376137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:11.765716 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.765682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83feb7e3-7f2f-40d5-a1dc-a073049c2191-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:11.768070 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:11.768044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83feb7e3-7f2f-40d5-a1dc-a073049c2191-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wfrs\" (UID: \"83feb7e3-7f2f-40d5-a1dc-a073049c2191\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:12.011629 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:12.011596    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"
Jul 24 19:42:12.136671 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:12.136648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs"]
Jul 24 19:42:12.138844 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:42:12.138819    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83feb7e3_7f2f_40d5_a1dc_a073049c2191.slice/crio-d315f3f40e2ba1420ec0fa04a450bbc19a833ce6ddc7aaf985eeb834835d3ba1 WatchSource:0}: Error finding container d315f3f40e2ba1420ec0fa04a450bbc19a833ce6ddc7aaf985eeb834835d3ba1: Status 404 returned error can't find the container with id d315f3f40e2ba1420ec0fa04a450bbc19a833ce6ddc7aaf985eeb834835d3ba1
Jul 24 19:42:12.744776 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:12.744743    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:12.849102 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:12.848998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:12.984714 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:12.984674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs" event={"ID":"83feb7e3-7f2f-40d5-a1dc-a073049c2191","Type":"ContainerStarted","Data":"d315f3f40e2ba1420ec0fa04a450bbc19a833ce6ddc7aaf985eeb834835d3ba1"}
Jul 24 19:42:19.874159 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:19.874086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:20.004704 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:20.004667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:22.174612 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:22.174569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:22.282808 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:22.282756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:25.164946 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:25.164911    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:25.265066 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:25.265032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:29.315098 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:29.315059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:29.414318 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:29.414287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:29.954846 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:29.954815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:30.054981 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:30.054954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:34.008010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:34.007934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:34.101008 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:34.100972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs" event={"ID":"83feb7e3-7f2f-40d5-a1dc-a073049c2191","Type":"ContainerStarted","Data":"3b4b1d539a2db19d5984f5bf945f07614ad441eceb4d470c284955be82bb2b73"}
Jul 24 19:42:34.120201 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:34.120168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:34.127616 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:34.127571    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wfrs" podStartSLOduration=1.545568616 podStartE2EDuration="23.127556928s" totalImagesPullingTime="21.581988312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:42:34.12653352 +0000 UTC m=+467.770796560" watchObservedRunningTime="2026-07-24 19:42:34.127556928 +0000 UTC m=+467.771820003"
Jul 24 19:42:43.568563 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:43.568532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:43.668754 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:43.668722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:46.563980 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:46.563933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:46.665284 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:46.665252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:50.019623 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:50.019593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:50.148669 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:50.148634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:51.869874 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:51.869843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:51.982337 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:51.982310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:52.037864 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.037840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:52.236799 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.236769    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:42:52.291537 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.291505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:42:52.291700 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.291545    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:42:52.291700 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.291637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.294042 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.294019    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 19:42:52.437811 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.437784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9317eac-4398-4244-b3dd-3c3496ab5efb-config-file\") pod \"limitador-limitador-54d6d988d5-74jmj\" (UID: \"b9317eac-4398-4244-b3dd-3c3496ab5efb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.437965 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.437858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6rp6\" (UniqueName: \"kubernetes.io/projected/b9317eac-4398-4244-b3dd-3c3496ab5efb-kube-api-access-g6rp6\") pod \"limitador-limitador-54d6d988d5-74jmj\" (UID: \"b9317eac-4398-4244-b3dd-3c3496ab5efb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.538446 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.538377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6rp6\" (UniqueName: \"kubernetes.io/projected/b9317eac-4398-4244-b3dd-3c3496ab5efb-kube-api-access-g6rp6\") pod \"limitador-limitador-54d6d988d5-74jmj\" (UID: \"b9317eac-4398-4244-b3dd-3c3496ab5efb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.538446 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.538424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9317eac-4398-4244-b3dd-3c3496ab5efb-config-file\") pod \"limitador-limitador-54d6d988d5-74jmj\" (UID: \"b9317eac-4398-4244-b3dd-3c3496ab5efb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.538990 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.538971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9317eac-4398-4244-b3dd-3c3496ab5efb-config-file\") pod \"limitador-limitador-54d6d988d5-74jmj\" (UID: \"b9317eac-4398-4244-b3dd-3c3496ab5efb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.545651 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.545628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6rp6\" (UniqueName: \"kubernetes.io/projected/b9317eac-4398-4244-b3dd-3c3496ab5efb-kube-api-access-g6rp6\") pod \"limitador-limitador-54d6d988d5-74jmj\" (UID: \"b9317eac-4398-4244-b3dd-3c3496ab5efb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.601499 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.601453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:52.695447 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.695418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:52.727121 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.727099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:42:52.729341 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:42:52.729317    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9317eac_4398_4244_b3dd_3c3496ab5efb.slice/crio-2e721b64bd79878fd0113d3341158522c80225ab7e8e3b0aaff71a6e70faf9fb WatchSource:0}: Error finding container 2e721b64bd79878fd0113d3341158522c80225ab7e8e3b0aaff71a6e70faf9fb: Status 404 returned error can't find the container with id 2e721b64bd79878fd0113d3341158522c80225ab7e8e3b0aaff71a6e70faf9fb
Jul 24 19:42:52.755330 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.755304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:42:52.824210 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.824155    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2nvw"]
Jul 24 19:42:52.828694 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.828679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:42:52.830872 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.830855    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6c2s4\""
Jul 24 19:42:52.835302 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.835282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2nvw"]
Jul 24 19:42:52.941964 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:52.941937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m8rs\" (UniqueName: \"kubernetes.io/projected/a46f72d2-a558-46d8-b118-a7e1745a5229-kube-api-access-4m8rs\") pod \"authorino-75d556bd77-v2nvw\" (UID: \"a46f72d2-a558-46d8-b118-a7e1745a5229\") " pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:42:53.043196 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:53.043173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m8rs\" (UniqueName: \"kubernetes.io/projected/a46f72d2-a558-46d8-b118-a7e1745a5229-kube-api-access-4m8rs\") pod \"authorino-75d556bd77-v2nvw\" (UID: \"a46f72d2-a558-46d8-b118-a7e1745a5229\") " pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:42:53.051103 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:53.051083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m8rs\" (UniqueName: \"kubernetes.io/projected/a46f72d2-a558-46d8-b118-a7e1745a5229-kube-api-access-4m8rs\") pod \"authorino-75d556bd77-v2nvw\" (UID: \"a46f72d2-a558-46d8-b118-a7e1745a5229\") " pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:42:53.138963 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:53.138905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:42:53.195127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:53.195086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj" event={"ID":"b9317eac-4398-4244-b3dd-3c3496ab5efb","Type":"ContainerStarted","Data":"2e721b64bd79878fd0113d3341158522c80225ab7e8e3b0aaff71a6e70faf9fb"}
Jul 24 19:42:53.289376 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:53.289345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2nvw"]
Jul 24 19:42:53.294728 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:42:53.294067    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda46f72d2_a558_46d8_b118_a7e1745a5229.slice/crio-5892cdc564d390396b90960d6db7e0939f25b065d04bab541b7af1007799ada0 WatchSource:0}: Error finding container 5892cdc564d390396b90960d6db7e0939f25b065d04bab541b7af1007799ada0: Status 404 returned error can't find the container with id 5892cdc564d390396b90960d6db7e0939f25b065d04bab541b7af1007799ada0
Jul 24 19:42:54.204125 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:54.204087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2nvw" event={"ID":"a46f72d2-a558-46d8-b118-a7e1745a5229","Type":"ContainerStarted","Data":"5892cdc564d390396b90960d6db7e0939f25b065d04bab541b7af1007799ada0"}
Jul 24 19:42:57.219693 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:57.219656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2nvw" event={"ID":"a46f72d2-a558-46d8-b118-a7e1745a5229","Type":"ContainerStarted","Data":"8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878"}
Jul 24 19:42:57.221219 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:57.221197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj" event={"ID":"b9317eac-4398-4244-b3dd-3c3496ab5efb","Type":"ContainerStarted","Data":"9916492df1ee2a434a00fc783a0efd1f96547df04ebdb446df5183fc0ef21b76"}
Jul 24 19:42:57.221333 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:57.221268    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:42:57.234363 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:57.234319    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-v2nvw" podStartSLOduration=1.475199476 podStartE2EDuration="5.234305825s" totalImagesPullingTime="3.759106349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:42:57.233288501 +0000 UTC m=+490.877551539" watchObservedRunningTime="2026-07-24 19:42:57.234305825 +0000 UTC m=+490.878568865"
Jul 24 19:42:57.252053 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:42:57.252013    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj" podStartSLOduration=0.939734753 podStartE2EDuration="5.252000769s" totalImagesPullingTime="4.312266016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:42:57.250866702 +0000 UTC m=+490.895129743" watchObservedRunningTime="2026-07-24 19:42:57.252000769 +0000 UTC m=+490.896263808"
Jul 24 19:43:08.226112 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:08.226084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-74jmj"
Jul 24 19:43:13.099259 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:13.099224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:13.199221 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:13.199190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:13.579521 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:13.579490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:25.207677 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:25.207636    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:25.319225 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:25.319196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:26.970497 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:26.970447    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2nvw"]
Jul 24 19:43:26.970968 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:26.970620    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-v2nvw" podUID="a46f72d2-a558-46d8-b118-a7e1745a5229" containerName="authorino" containerID="cri-o://8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878" gracePeriod=30
Jul 24 19:43:27.268104 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.268076    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:43:27.329541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.329507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m8rs\" (UniqueName: \"kubernetes.io/projected/a46f72d2-a558-46d8-b118-a7e1745a5229-kube-api-access-4m8rs\") pod \"a46f72d2-a558-46d8-b118-a7e1745a5229\" (UID: \"a46f72d2-a558-46d8-b118-a7e1745a5229\") "
Jul 24 19:43:27.331475 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.331426    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46f72d2-a558-46d8-b118-a7e1745a5229-kube-api-access-4m8rs" (OuterVolumeSpecName: "kube-api-access-4m8rs") pod "a46f72d2-a558-46d8-b118-a7e1745a5229" (UID: "a46f72d2-a558-46d8-b118-a7e1745a5229"). InnerVolumeSpecName "kube-api-access-4m8rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:43:27.355926 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.355888    2560 generic.go:356] "Generic (PLEG): container finished" podID="a46f72d2-a558-46d8-b118-a7e1745a5229" containerID="8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878" exitCode=0
Jul 24 19:43:27.356036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.355932    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-v2nvw"
Jul 24 19:43:27.356036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.355970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2nvw" event={"ID":"a46f72d2-a558-46d8-b118-a7e1745a5229","Type":"ContainerDied","Data":"8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878"}
Jul 24 19:43:27.356036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.356015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-v2nvw" event={"ID":"a46f72d2-a558-46d8-b118-a7e1745a5229","Type":"ContainerDied","Data":"5892cdc564d390396b90960d6db7e0939f25b065d04bab541b7af1007799ada0"}
Jul 24 19:43:27.356163 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.356037    2560 scope.go:117] "RemoveContainer" containerID="8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878"
Jul 24 19:43:27.364041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.364025    2560 scope.go:117] "RemoveContainer" containerID="8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878"
Jul 24 19:43:27.364276 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:43:27.364257    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878\": container with ID starting with 8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878 not found: ID does not exist" containerID="8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878"
Jul 24 19:43:27.364325 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.364282    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878"} err="failed to get container status \"8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878\": rpc error: code = NotFound desc = could not find container \"8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878\": container with ID starting with 8131e5e2b001738c7f98390de2c371b31603020d63b8376a86c06b277adea878 not found: ID does not exist"
Jul 24 19:43:27.375276 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.375255    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2nvw"]
Jul 24 19:43:27.377498 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.377478    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-v2nvw"]
Jul 24 19:43:27.430288 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:27.430267    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m8rs\" (UniqueName: \"kubernetes.io/projected/a46f72d2-a558-46d8-b118-a7e1745a5229-kube-api-access-4m8rs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:43:28.842880 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:28.842846    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46f72d2-a558-46d8-b118-a7e1745a5229" path="/var/lib/kubelet/pods/a46f72d2-a558-46d8-b118-a7e1745a5229/volumes"
Jul 24 19:43:31.649855 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:31.649823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:31.708772 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:31.708741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:31.883161 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:31.883122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:34.839528 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:34.839478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:34.946649 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:34.946606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:43:35.790869 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:43:35.790835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:05.460217 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:05.460188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:05.558589 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:05.558561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:06.120174 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.120144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:06.216879 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.216848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:06.598693 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.598665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:06.695933 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.695899    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:06.740661 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.740633    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-84npd"]
Jul 24 19:44:06.740978 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.740967    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46f72d2-a558-46d8-b118-a7e1745a5229" containerName="authorino"
Jul 24 19:44:06.741021 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.740980    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46f72d2-a558-46d8-b118-a7e1745a5229" containerName="authorino"
Jul 24 19:44:06.741062 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.741048    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46f72d2-a558-46d8-b118-a7e1745a5229" containerName="authorino"
Jul 24 19:44:06.745192 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.745178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:06.747788 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.747771    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 19:44:06.747896 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.747773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dzxmh\""
Jul 24 19:44:06.754796 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.754773    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-84npd"]
Jul 24 19:44:06.790733 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.790704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:44:06.864478 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.864378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qhr\" (UniqueName: \"kubernetes.io/projected/4f2c48f6-1b66-440d-a848-5af660395855-kube-api-access-l4qhr\") pod \"payload-processing-5cc6cd444b-84npd\" (UID: \"4f2c48f6-1b66-440d-a848-5af660395855\") " pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:06.864628 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.864548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2c48f6-1b66-440d-a848-5af660395855-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-84npd\" (UID: \"4f2c48f6-1b66-440d-a848-5af660395855\") " pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:06.965545 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.965515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qhr\" (UniqueName: \"kubernetes.io/projected/4f2c48f6-1b66-440d-a848-5af660395855-kube-api-access-l4qhr\") pod \"payload-processing-5cc6cd444b-84npd\" (UID: \"4f2c48f6-1b66-440d-a848-5af660395855\") " pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:06.965678 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.965604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2c48f6-1b66-440d-a848-5af660395855-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-84npd\" (UID: \"4f2c48f6-1b66-440d-a848-5af660395855\") " pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:06.966265 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.966248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f2c48f6-1b66-440d-a848-5af660395855-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-84npd\" (UID: \"4f2c48f6-1b66-440d-a848-5af660395855\") " pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:06.974937 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:06.974919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qhr\" (UniqueName: \"kubernetes.io/projected/4f2c48f6-1b66-440d-a848-5af660395855-kube-api-access-l4qhr\") pod \"payload-processing-5cc6cd444b-84npd\" (UID: \"4f2c48f6-1b66-440d-a848-5af660395855\") " pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:07.056529 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:07.056499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:07.184220 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:07.184197    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-84npd"]
Jul 24 19:44:07.538941 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:07.538910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd" event={"ID":"4f2c48f6-1b66-440d-a848-5af660395855","Type":"ContainerStarted","Data":"b5c642d22b1461af61bb5385182b5d19cb65b05dbd405b751957dc77f5497bae"}
Jul 24 19:44:09.551416 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:09.551376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd" event={"ID":"4f2c48f6-1b66-440d-a848-5af660395855","Type":"ContainerStarted","Data":"d55a75f4bf748fd98fb8579ede216667ab9f03868327a91dab7e7c04df9e58ed"}
Jul 24 19:44:09.551856 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:09.551522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:09.567552 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:09.567504    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd" podStartSLOduration=1.9967137 podStartE2EDuration="3.567491717s" totalImagesPullingTime="1.570778017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:44:09.565804783 +0000 UTC m=+563.210067850" watchObservedRunningTime="2026-07-24 19:44:09.567491717 +0000 UTC m=+563.211754757"
Jul 24 19:44:11.306670 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:11.306623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:16.101947 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:16.101901    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:16.209510 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:16.209447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:20.558384 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:20.558353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-84npd"
Jul 24 19:44:33.845799 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:33.845764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:34.314418 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:34.314388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:44:42.438159 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:42.438116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:42.908931 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:42.908904    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:44:49.610589 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.610555    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"]
Jul 24 19:44:49.615091 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.615073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.618440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.618414    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x9sks\""
Jul 24 19:44:49.618440 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.618430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 19:44:49.618643 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.618450    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 19:44:49.618643 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.618482    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 19:44:49.622645 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.622219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"]
Jul 24 19:44:49.701943 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.701921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:49.732642 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.732616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.732744 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.732654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9ld\" (UniqueName: \"kubernetes.io/projected/3de2833f-b234-4eb1-89e2-24b10cc94eb4-kube-api-access-jp9ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.732744 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.732718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.732820 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.732744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.732820 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.732807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.732882 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.732866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3de2833f-b234-4eb1-89e2-24b10cc94eb4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.833853 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.833826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.833949 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.833864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9ld\" (UniqueName: \"kubernetes.io/projected/3de2833f-b234-4eb1-89e2-24b10cc94eb4-kube-api-access-jp9ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.833949 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.833907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.833949 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.833942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.834071 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.833971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.834071 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.834031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3de2833f-b234-4eb1-89e2-24b10cc94eb4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.834259 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.834240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.834325 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.834294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.834428 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.834402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.836293 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.836277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3de2833f-b234-4eb1-89e2-24b10cc94eb4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.836395 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.836375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3de2833f-b234-4eb1-89e2-24b10cc94eb4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.841308 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.841284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9ld\" (UniqueName: \"kubernetes.io/projected/3de2833f-b234-4eb1-89e2-24b10cc94eb4-kube-api-access-jp9ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wnsnd\" (UID: \"3de2833f-b234-4eb1-89e2-24b10cc94eb4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:49.926830 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:49.926807    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:50.051128 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:50.051084    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"]
Jul 24 19:44:50.053393 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:44:50.053363    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de2833f_b234_4eb1_89e2_24b10cc94eb4.slice/crio-e2fd54cbc9428150a48049ff2a09059852afc243a885be3a4c33e0d1c1d8fe59 WatchSource:0}: Error finding container e2fd54cbc9428150a48049ff2a09059852afc243a885be3a4c33e0d1c1d8fe59: Status 404 returned error can't find the container with id e2fd54cbc9428150a48049ff2a09059852afc243a885be3a4c33e0d1c1d8fe59
Jul 24 19:44:50.733890 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:50.733858    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd" event={"ID":"3de2833f-b234-4eb1-89e2-24b10cc94eb4","Type":"ContainerStarted","Data":"e2fd54cbc9428150a48049ff2a09059852afc243a885be3a4c33e0d1c1d8fe59"}
Jul 24 19:44:50.819471 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:50.819430    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:44:51.740818 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:51.740786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd" event={"ID":"3de2833f-b234-4eb1-89e2-24b10cc94eb4","Type":"ContainerStarted","Data":"e02e4f6bd08515c6e6908957f629089ea6f5fe613d6f6ae50070c01ef5ae550a"}
Jul 24 19:44:51.760166 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:51.760118    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd" podStartSLOduration=1.718957415 podStartE2EDuration="2.76010411s" totalImagesPullingTime="1.041146695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:44:51.758870266 +0000 UTC m=+605.403133306" watchObservedRunningTime="2026-07-24 19:44:51.76010411 +0000 UTC m=+605.404367150"
Jul 24 19:44:52.286436 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:52.286397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:57.958047 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:57.958007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:44:59.623354 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:59.623321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:44:59.927463 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:59.927438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:59.927604 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:59.927508    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:44:59.939403 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:44:59.939385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:45:00.138296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.138262    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"]
Jul 24 19:45:00.142164 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.142148    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"
Jul 24 19:45:00.144596 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.144576    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 19:45:00.152097 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.152076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"
Jul 24 19:45:00.152242 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.152223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"]
Jul 24 19:45:00.279161 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.279069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"]
Jul 24 19:45:00.281782 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:45:00.281748    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb047630_33e2_4f1d_b74a_ed862deb54ca.slice/crio-8062a33e3fb15183233c16c431eacd56a1de0d03998a91b814320f79fccf7057 WatchSource:0}: Error finding container 8062a33e3fb15183233c16c431eacd56a1de0d03998a91b814320f79fccf7057: Status 404 returned error can't find the container with id 8062a33e3fb15183233c16c431eacd56a1de0d03998a91b814320f79fccf7057
Jul 24 19:45:00.784927 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.784896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws" event={"ID":"db047630-33e2-4f1d-b74a-ed862deb54ca","Type":"ContainerStarted","Data":"8062a33e3fb15183233c16c431eacd56a1de0d03998a91b814320f79fccf7057"}
Jul 24 19:45:00.796005 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:00.795984    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wnsnd"
Jul 24 19:45:03.802235 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:03.802137    2560 generic.go:356] "Generic (PLEG): container finished" podID="db047630-33e2-4f1d-b74a-ed862deb54ca" containerID="35cc04f0a1ec0fc9ebc8db0ee4a643336c6f93e75cc4aa2c456474cd0b446e90" exitCode=0
Jul 24 19:45:03.802630 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:03.802226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws" event={"ID":"db047630-33e2-4f1d-b74a-ed862deb54ca","Type":"ContainerDied","Data":"35cc04f0a1ec0fc9ebc8db0ee4a643336c6f93e75cc4aa2c456474cd0b446e90"}
Jul 24 19:45:04.940355 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:04.940331    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"
Jul 24 19:45:05.814049 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:05.814018    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws"
Jul 24 19:45:05.814211 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:05.814054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748705-7zsws" event={"ID":"db047630-33e2-4f1d-b74a-ed862deb54ca","Type":"ContainerDied","Data":"8062a33e3fb15183233c16c431eacd56a1de0d03998a91b814320f79fccf7057"}
Jul 24 19:45:05.814211 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:05.814098    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8062a33e3fb15183233c16c431eacd56a1de0d03998a91b814320f79fccf7057"
Jul 24 19:45:08.105754 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.105723    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"]
Jul 24 19:45:08.106316 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.106298    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db047630-33e2-4f1d-b74a-ed862deb54ca" containerName="cleanup"
Jul 24 19:45:08.106316 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.106316    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="db047630-33e2-4f1d-b74a-ed862deb54ca" containerName="cleanup"
Jul 24 19:45:08.106473 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.106435    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="db047630-33e2-4f1d-b74a-ed862deb54ca" containerName="cleanup"
Jul 24 19:45:08.109823 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.109796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.112279 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.112262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 19:45:08.120327 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.120306    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"]
Jul 24 19:45:08.136050 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.136029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:45:08.190512 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.190488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.190598 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.190531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.190598 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.190554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7631bdcd-72ee-4c4e-af90-6840a9a20893-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.190598 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.190572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5dfv\" (UniqueName: \"kubernetes.io/projected/7631bdcd-72ee-4c4e-af90-6840a9a20893-kube-api-access-p5dfv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.190720 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.190615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.190720 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.190652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.291608 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.291581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.291696 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.291611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.291696 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.291663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.291786 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.291715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.291786 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.291742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7631bdcd-72ee-4c4e-af90-6840a9a20893-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.291786 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.291769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5dfv\" (UniqueName: \"kubernetes.io/projected/7631bdcd-72ee-4c4e-af90-6840a9a20893-kube-api-access-p5dfv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.292030 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.292007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.292115 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.292036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.292178 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.292119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.294023 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.294003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7631bdcd-72ee-4c4e-af90-6840a9a20893-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.294314 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.294295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7631bdcd-72ee-4c4e-af90-6840a9a20893-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.299505 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.299484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5dfv\" (UniqueName: \"kubernetes.io/projected/7631bdcd-72ee-4c4e-af90-6840a9a20893-kube-api-access-p5dfv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wlfgg\" (UID: \"7631bdcd-72ee-4c4e-af90-6840a9a20893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.420541 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.420515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:08.545928 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.545901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"]
Jul 24 19:45:08.548005 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:45:08.547976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7631bdcd_72ee_4c4e_af90_6840a9a20893.slice/crio-39ea9a0d9b0990337be945668dc4595f287ca0455577e6d2e613dff2d6b71a5f WatchSource:0}: Error finding container 39ea9a0d9b0990337be945668dc4595f287ca0455577e6d2e613dff2d6b71a5f: Status 404 returned error can't find the container with id 39ea9a0d9b0990337be945668dc4595f287ca0455577e6d2e613dff2d6b71a5f
Jul 24 19:45:08.549285 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.549265    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:45:08.828856 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.828826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg" event={"ID":"7631bdcd-72ee-4c4e-af90-6840a9a20893","Type":"ContainerStarted","Data":"e65644bbf7850778336264c6de1755f2b227e15080c807419c49ffde0bb16960"}
Jul 24 19:45:08.828975 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.828893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg" event={"ID":"7631bdcd-72ee-4c4e-af90-6840a9a20893","Type":"ContainerStarted","Data":"39ea9a0d9b0990337be945668dc4595f287ca0455577e6d2e613dff2d6b71a5f"}
Jul 24 19:45:08.845169 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:08.845125    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg" podStartSLOduration=0.637042608 podStartE2EDuration="845.108915ms" totalImagesPullingTime="208.066307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:45:08.843826796 +0000 UTC m=+622.488089838" watchObservedRunningTime="2026-07-24 19:45:08.845108915 +0000 UTC m=+622.489371955"
Jul 24 19:45:10.311664 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:10.311631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:45:18.339880 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:18.339844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:45:18.420710 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:18.420680    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:18.420860 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:18.420732    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:18.433088 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:18.433059    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:18.883165 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:18.883136    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wlfgg"
Jul 24 19:45:22.310166 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:22.310134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:45:31.893248 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:31.893213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:45:31.942711 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:45:31.942684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:46:25.833681 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:46:25.833648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:46:38.168154 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:46:38.168117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:46:38.255512 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:46:38.255478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:46:39.313935 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:46:39.313905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:46:39.412608 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:46:39.412580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:47:06.718041 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:47:06.718006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:47:09.844912 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:47:09.844880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:47:17.507628 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:47:17.507593    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:47:28.815194 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:47:28.815161    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:48:43.945735 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:48:43.945696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:48:45.136267 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:48:45.136225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:09.214588 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:09.214554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:49:20.739388 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:20.739354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:20.839675 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:20.839620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:20.958233 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:20.958200    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:26.889431 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:26.889399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:26.948781 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:26.948756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:27.031370 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:27.031348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:27.127668 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:27.127639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:27.242819 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:27.242798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:32.918708 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:32.918667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:32.972940 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:32.972906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:49:50.111176 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:49:50.111140    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:00.010958 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:00.010929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:10.214014 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:10.213982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:18.109656 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:18.109624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:28.010753 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:28.010721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:28.268539 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:28.268442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:50:29.526132 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:29.526100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:50:40.506741 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:40.506704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:52.414681 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:52.414649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:50:54.625058 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:54.625011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:50:54.721950 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:50:54.721921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:51:00.554009 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:51:00.553978    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:51:25.509374 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:51:25.509334    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:51:36.013951 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:51:36.013921    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:51:59.221292 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:51:59.221257    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:52:12.011727 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:52:12.011693    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:52:28.288191 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:52:28.288156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:52:38.017247 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:52:38.017201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:52:47.922932 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:52:47.922855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:52:57.510889 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:52:57.510853    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:53:07.126847 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:53:07.126814    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:53:15.658062 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:53:15.658024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:53:15.718025 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:53:15.717984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:53:44.321497 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:53:44.321439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:53:50.064648 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:53:50.064607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:54:54.705977 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:54:54.705934    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:55:06.018524 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:55:06.018486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:55:15.523864 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:55:15.523831    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:55:27.513607 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:55:27.513567    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:55:38.505225 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:55:38.505132    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:55:49.308165 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:55:49.308131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:55:57.717251 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:55:57.717217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:56:09.308643 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:56:09.308607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:56:18.912663 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:56:18.912629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:56:29.312108 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:56:29.312076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:56:41.714452 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:56:41.714417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:57:03.321571 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:03.321540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:57:12.909739 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:12.909641    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:57:13.115107 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.115077    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"]
Jul 24 19:57:13.119124 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.119107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.121452 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.121430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c72f5a8c-kserve-self-signed-certs\""
Jul 24 19:57:13.132941 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.132910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"]
Jul 24 19:57:13.172603 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.172518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:57:13.210920 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.210892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-dshm\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.211036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.210929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26082794-50aa-4336-b602-0b0f763c7ce3-tls-certs\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.211036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.210970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-tmp-dir\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.211135 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.211035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-home\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.211135 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.211074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kbf2\" (UniqueName: \"kubernetes.io/projected/26082794-50aa-4336-b602-0b0f763c7ce3-kube-api-access-9kbf2\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.211214 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.211138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-model-cache\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312010 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.311989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-model-cache\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-dshm\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26082794-50aa-4336-b602-0b0f763c7ce3-tls-certs\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-tmp-dir\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312127 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-home\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312330 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kbf2\" (UniqueName: \"kubernetes.io/projected/26082794-50aa-4336-b602-0b0f763c7ce3-kube-api-access-9kbf2\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312497 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-model-cache\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312573 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-tmp-dir\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.312573 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.312557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-home\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.314182 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.314162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-dshm\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.314423 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.314409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26082794-50aa-4336-b602-0b0f763c7ce3-tls-certs\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.319637 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.319618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kbf2\" (UniqueName: \"kubernetes.io/projected/26082794-50aa-4336-b602-0b0f763c7ce3-kube-api-access-9kbf2\") pod \"e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") " pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.428836 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.428774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:13.560488 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:13.560437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"]
Jul 24 19:57:13.562406 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:57:13.562378    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26082794_50aa_4336_b602_0b0f763c7ce3.slice/crio-8622e598f8ab0b254be9a846ba6cfc31cc347136a5cc7a08bd2d1f04d74ec643 WatchSource:0}: Error finding container 8622e598f8ab0b254be9a846ba6cfc31cc347136a5cc7a08bd2d1f04d74ec643: Status 404 returned error can't find the container with id 8622e598f8ab0b254be9a846ba6cfc31cc347136a5cc7a08bd2d1f04d74ec643
Jul 24 19:57:14.244709 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:14.244670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv" event={"ID":"26082794-50aa-4336-b602-0b0f763c7ce3","Type":"ContainerStarted","Data":"b6d9ad5358576fcf42e66580c87892287c996825204d2fa19f46e241b72b132c"}
Jul 24 19:57:14.244709 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:14.244714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv" event={"ID":"26082794-50aa-4336-b602-0b0f763c7ce3","Type":"ContainerStarted","Data":"8622e598f8ab0b254be9a846ba6cfc31cc347136a5cc7a08bd2d1f04d74ec643"}
Jul 24 19:57:14.265090 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:14.265048    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv" podStartSLOduration=1.265032934 podStartE2EDuration="1.265032934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:14.264491053 +0000 UTC m=+1347.908754085" watchObservedRunningTime="2026-07-24 19:57:14.265032934 +0000 UTC m=+1347.909295973"
Jul 24 19:57:23.429391 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:23.429364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:23.429760 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:23.429423    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:23.441554 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:23.441529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:24.300764 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:24.300729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:25.017915 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.017881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:57:25.192536 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.192497    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"]
Jul 24 19:57:25.196187 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.196164    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.198784 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.198757    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c72f5a8c-kserve-self-signed-certs\""
Jul 24 19:57:25.205296 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.205266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"]
Jul 24 19:57:25.291701 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.291600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-dshm\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.291701 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.291654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a514c18-ac68-4032-9d97-98ca7af28f24-tls-certs\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.291916 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.291751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-model-cache\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.291916 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.291788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-home\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.291916 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.291848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-tmp-dir\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.291916 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.291893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwjw\" (UniqueName: \"kubernetes.io/projected/8a514c18-ac68-4032-9d97-98ca7af28f24-kube-api-access-wjwjw\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.314322 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.314278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:57:25.392972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.392927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-home\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.392972 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.392983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-tmp-dir\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393246 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwjw\" (UniqueName: \"kubernetes.io/projected/8a514c18-ac68-4032-9d97-98ca7af28f24-kube-api-access-wjwjw\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393246 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-dshm\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393246 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a514c18-ac68-4032-9d97-98ca7af28f24-tls-certs\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393410 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-model-cache\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393410 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-home\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393688 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-model-cache\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.393825 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.393809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-tmp-dir\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.395452 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.395430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-dshm\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.395715 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.395697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a514c18-ac68-4032-9d97-98ca7af28f24-tls-certs\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.402308 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.402283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwjw\" (UniqueName: \"kubernetes.io/projected/8a514c18-ac68-4032-9d97-98ca7af28f24-kube-api-access-wjwjw\") pod \"e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") " pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.506879 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.506850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:25.636745 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:25.636721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"]
Jul 24 19:57:25.638831 ip-10-0-130-158 kubenswrapper[2560]: W0724 19:57:25.638805    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a514c18_ac68_4032_9d97_98ca7af28f24.slice/crio-1d8c104f79bf8db70912b1fb6ea1cf9ea61bbd108a5208730be515913671133c WatchSource:0}: Error finding container 1d8c104f79bf8db70912b1fb6ea1cf9ea61bbd108a5208730be515913671133c: Status 404 returned error can't find the container with id 1d8c104f79bf8db70912b1fb6ea1cf9ea61bbd108a5208730be515913671133c
Jul 24 19:57:26.301379 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:26.301339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw" event={"ID":"8a514c18-ac68-4032-9d97-98ca7af28f24","Type":"ContainerStarted","Data":"ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933"}
Jul 24 19:57:26.301890 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:26.301389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw" event={"ID":"8a514c18-ac68-4032-9d97-98ca7af28f24","Type":"ContainerStarted","Data":"1d8c104f79bf8db70912b1fb6ea1cf9ea61bbd108a5208730be515913671133c"}
Jul 24 19:57:26.319021 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:26.318968    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw" podStartSLOduration=1.318952494 podStartE2EDuration="1.318952494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:57:26.317365621 +0000 UTC m=+1359.961628662" watchObservedRunningTime="2026-07-24 19:57:26.318952494 +0000 UTC m=+1359.963215534"
Jul 24 19:57:35.507729 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:35.507697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:35.508204 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:35.507744    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:35.519873 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:35.519852    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:36.360025 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:36.359995    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:36.516598 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:36.516566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:57:43.191351 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:43.191318    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"]
Jul 24 19:57:43.213006 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:43.212979    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:57:44.627756 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:44.627713    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"]
Jul 24 19:57:44.648176 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:44.648149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:57:47.318863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:47.318834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:57:58.210333 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.210291    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv" podUID="26082794-50aa-4336-b602-0b0f763c7ce3" containerName="main" containerID="cri-o://b6d9ad5358576fcf42e66580c87892287c996825204d2fa19f46e241b72b132c" gracePeriod=45
Jul 24 19:57:58.454413 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.454385    2560 generic.go:356] "Generic (PLEG): container finished" podID="26082794-50aa-4336-b602-0b0f763c7ce3" containerID="b6d9ad5358576fcf42e66580c87892287c996825204d2fa19f46e241b72b132c" exitCode=0
Jul 24 19:57:58.454557 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.454483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv" event={"ID":"26082794-50aa-4336-b602-0b0f763c7ce3","Type":"ContainerDied","Data":"b6d9ad5358576fcf42e66580c87892287c996825204d2fa19f46e241b72b132c"}
Jul 24 19:57:58.454557 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.454523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv" event={"ID":"26082794-50aa-4336-b602-0b0f763c7ce3","Type":"ContainerDied","Data":"8622e598f8ab0b254be9a846ba6cfc31cc347136a5cc7a08bd2d1f04d74ec643"}
Jul 24 19:57:58.454557 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.454538    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8622e598f8ab0b254be9a846ba6cfc31cc347136a5cc7a08bd2d1f04d74ec643"
Jul 24 19:57:58.467703 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.467651    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:58.554397 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554367    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-dshm\") pod \"26082794-50aa-4336-b602-0b0f763c7ce3\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") "
Jul 24 19:57:58.554599 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554428    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26082794-50aa-4336-b602-0b0f763c7ce3-tls-certs\") pod \"26082794-50aa-4336-b602-0b0f763c7ce3\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") "
Jul 24 19:57:58.554599 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554549    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-home\") pod \"26082794-50aa-4336-b602-0b0f763c7ce3\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") "
Jul 24 19:57:58.554599 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554586    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-model-cache\") pod \"26082794-50aa-4336-b602-0b0f763c7ce3\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") "
Jul 24 19:57:58.554738 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554606    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-tmp-dir\") pod \"26082794-50aa-4336-b602-0b0f763c7ce3\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") "
Jul 24 19:57:58.554738 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554682    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kbf2\" (UniqueName: \"kubernetes.io/projected/26082794-50aa-4336-b602-0b0f763c7ce3-kube-api-access-9kbf2\") pod \"26082794-50aa-4336-b602-0b0f763c7ce3\" (UID: \"26082794-50aa-4336-b602-0b0f763c7ce3\") "
Jul 24 19:57:58.554849 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554801    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-model-cache" (OuterVolumeSpecName: "model-cache") pod "26082794-50aa-4336-b602-0b0f763c7ce3" (UID: "26082794-50aa-4336-b602-0b0f763c7ce3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:58.554849 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-home" (OuterVolumeSpecName: "home") pod "26082794-50aa-4336-b602-0b0f763c7ce3" (UID: "26082794-50aa-4336-b602-0b0f763c7ce3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:58.554953 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.554927    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26082794-50aa-4336-b602-0b0f763c7ce3" (UID: "26082794-50aa-4336-b602-0b0f763c7ce3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:58.555089 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.555070    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:58.555152 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.555093    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:58.555152 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.555108    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:58.556920 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.556880    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26082794-50aa-4336-b602-0b0f763c7ce3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26082794-50aa-4336-b602-0b0f763c7ce3" (UID: "26082794-50aa-4336-b602-0b0f763c7ce3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:57:58.557036 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.557008    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-dshm" (OuterVolumeSpecName: "dshm") pod "26082794-50aa-4336-b602-0b0f763c7ce3" (UID: "26082794-50aa-4336-b602-0b0f763c7ce3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:58.557255 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.557226    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26082794-50aa-4336-b602-0b0f763c7ce3-kube-api-access-9kbf2" (OuterVolumeSpecName: "kube-api-access-9kbf2") pod "26082794-50aa-4336-b602-0b0f763c7ce3" (UID: "26082794-50aa-4336-b602-0b0f763c7ce3"). InnerVolumeSpecName "kube-api-access-9kbf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:57:58.655644 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.655617    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26082794-50aa-4336-b602-0b0f763c7ce3-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:58.655644 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.655640    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26082794-50aa-4336-b602-0b0f763c7ce3-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:58.655790 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:58.655654    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kbf2\" (UniqueName: \"kubernetes.io/projected/26082794-50aa-4336-b602-0b0f763c7ce3-kube-api-access-9kbf2\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:59.459237 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.459199    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"
Jul 24 19:57:59.477504 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.477450    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"]
Jul 24 19:57:59.479125 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.479106    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c72f5a8c-kserve-f894cc96c-g5btv"]
Jul 24 19:57:59.646895 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.646841    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw" podUID="8a514c18-ac68-4032-9d97-98ca7af28f24" containerName="main" containerID="cri-o://ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933" gracePeriod=45
Jul 24 19:57:59.901175 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.901149    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:57:59.967564 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967528    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-home\") pod \"8a514c18-ac68-4032-9d97-98ca7af28f24\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") "
Jul 24 19:57:59.967742 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967617    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-dshm\") pod \"8a514c18-ac68-4032-9d97-98ca7af28f24\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") "
Jul 24 19:57:59.967742 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967648    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-tmp-dir\") pod \"8a514c18-ac68-4032-9d97-98ca7af28f24\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") "
Jul 24 19:57:59.967742 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967713    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjwjw\" (UniqueName: \"kubernetes.io/projected/8a514c18-ac68-4032-9d97-98ca7af28f24-kube-api-access-wjwjw\") pod \"8a514c18-ac68-4032-9d97-98ca7af28f24\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") "
Jul 24 19:57:59.967863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967741    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a514c18-ac68-4032-9d97-98ca7af28f24-tls-certs\") pod \"8a514c18-ac68-4032-9d97-98ca7af28f24\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") "
Jul 24 19:57:59.967863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967779    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-model-cache\") pod \"8a514c18-ac68-4032-9d97-98ca7af28f24\" (UID: \"8a514c18-ac68-4032-9d97-98ca7af28f24\") "
Jul 24 19:57:59.967863 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967825    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-home" (OuterVolumeSpecName: "home") pod "8a514c18-ac68-4032-9d97-98ca7af28f24" (UID: "8a514c18-ac68-4032-9d97-98ca7af28f24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:59.968018 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.967996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a514c18-ac68-4032-9d97-98ca7af28f24" (UID: "8a514c18-ac68-4032-9d97-98ca7af28f24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:59.968109 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.968085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a514c18-ac68-4032-9d97-98ca7af28f24" (UID: "8a514c18-ac68-4032-9d97-98ca7af28f24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:59.968562 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.968538    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:59.968684 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.968564    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:59.968684 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.968577    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:57:59.969922 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.969900    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-dshm" (OuterVolumeSpecName: "dshm") pod "8a514c18-ac68-4032-9d97-98ca7af28f24" (UID: "8a514c18-ac68-4032-9d97-98ca7af28f24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:57:59.970020 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.969953    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a514c18-ac68-4032-9d97-98ca7af28f24-kube-api-access-wjwjw" (OuterVolumeSpecName: "kube-api-access-wjwjw") pod "8a514c18-ac68-4032-9d97-98ca7af28f24" (UID: "8a514c18-ac68-4032-9d97-98ca7af28f24"). InnerVolumeSpecName "kube-api-access-wjwjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:57:59.970020 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:57:59.969997    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a514c18-ac68-4032-9d97-98ca7af28f24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a514c18-ac68-4032-9d97-98ca7af28f24" (UID: "8a514c18-ac68-4032-9d97-98ca7af28f24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:58:00.069534 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.069426    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjwjw\" (UniqueName: \"kubernetes.io/projected/8a514c18-ac68-4032-9d97-98ca7af28f24-kube-api-access-wjwjw\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:58:00.069534 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.069469    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a514c18-ac68-4032-9d97-98ca7af28f24-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:58:00.069534 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.069479    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a514c18-ac68-4032-9d97-98ca7af28f24-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 19:58:00.464784 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.464750    2560 generic.go:356] "Generic (PLEG): container finished" podID="8a514c18-ac68-4032-9d97-98ca7af28f24" containerID="ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933" exitCode=0
Jul 24 19:58:00.465193 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.464799    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"
Jul 24 19:58:00.465193 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.464798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw" event={"ID":"8a514c18-ac68-4032-9d97-98ca7af28f24","Type":"ContainerDied","Data":"ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933"}
Jul 24 19:58:00.465193 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.464918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw" event={"ID":"8a514c18-ac68-4032-9d97-98ca7af28f24","Type":"ContainerDied","Data":"1d8c104f79bf8db70912b1fb6ea1cf9ea61bbd108a5208730be515913671133c"}
Jul 24 19:58:00.465193 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.464944    2560 scope.go:117] "RemoveContainer" containerID="ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933"
Jul 24 19:58:00.473797 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.473783    2560 scope.go:117] "RemoveContainer" containerID="ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933"
Jul 24 19:58:00.474032 ip-10-0-130-158 kubenswrapper[2560]: E0724 19:58:00.474013    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933\": container with ID starting with ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933 not found: ID does not exist" containerID="ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933"
Jul 24 19:58:00.474090 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.474039    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933"} err="failed to get container status \"ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933\": rpc error: code = NotFound desc = could not find container \"ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933\": container with ID starting with ced0c4469fbdb64c6624f56085e3953e042bfbf341d184f864d59c7c71db9933 not found: ID does not exist"
Jul 24 19:58:00.487293 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.487274    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"]
Jul 24 19:58:00.491043 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.491025    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c72f5a8c-kserve-7ffb7877cf-qbwgw"]
Jul 24 19:58:00.842502 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.842421    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26082794-50aa-4336-b602-0b0f763c7ce3" path="/var/lib/kubelet/pods/26082794-50aa-4336-b602-0b0f763c7ce3/volumes"
Jul 24 19:58:00.842877 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:00.842857    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a514c18-ac68-4032-9d97-98ca7af28f24" path="/var/lib/kubelet/pods/8a514c18-ac68-4032-9d97-98ca7af28f24/volumes"
Jul 24 19:58:01.723476 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:01.723419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:58:08.308402 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:08.308358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:58:24.516996 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:24.516959    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:58:34.102444 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:34.102407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:58:43.412356 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:43.412281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:58:51.727257 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:51.727219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:58:54.350183 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:58:54.350152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:59:01.623375 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:01.623343    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:59:08.206824 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:08.206789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:59:09.792006 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:09.791957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 19:59:11.016955 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:11.016917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:59:24.720913 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:24.720874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:59:34.023755 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:34.023724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:59:44.317761 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:44.317728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 19:59:56.711521 ip-10-0-130-158 kubenswrapper[2560]: I0724 19:59:56.711475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:00:05.910160 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:00:05.910126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:00:12.612399 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:00:12.612369    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:00:29.322943 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:00:29.322899    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:00:41.516306 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:00:41.516267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:00:52.810725 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:00:52.810688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:00:55.379577 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:00:55.379543    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:04.211814 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:04.211708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:01:15.444385 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:15.444353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:18.439056 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:18.439019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:18.538926 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:18.538894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:18.888685 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:18.888619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:19.415432 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:19.415402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:01:24.682049 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:24.682011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:24.733492 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:24.733439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:24.846414 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:24.846385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:25.150541 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:25.150444    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:25.345576 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:25.345545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:26.204672 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:26.204642    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:27.695975 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:27.695941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:27.792010 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:27.791984    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:27.891346 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:27.891320    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:28.098731 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:28.098661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:28.389135 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:28.389066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:28.474215 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:28.474185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:01:33.618945 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:01:33.618908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:02:03.769521 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:03.769406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:03.851175 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:03.851125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:03.951940 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:03.951907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:07.017159 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:07.017115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:02:08.295592 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:08.295529    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:08.445669 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:08.445639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:08.657130 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:08.657051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:08.900508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:08.900476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:09.000107 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:09.000080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:09.167321 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:09.167296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:09.426770 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:09.426746    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:09.548941 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:09.548911    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:12.047973 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:12.047944    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:12.175176 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:12.175138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:12.323517 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:12.323436    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:12.660808 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:12.660782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:13.008246 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:13.008172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:18.414772 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:18.414734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:02:47.619976 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:47.619945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:49.116159 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:49.116123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:50.510918 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:50.510882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:02:52.130339 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:52.130305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:52.293252 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:52.293205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:52.529590 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:52.529501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:52.770857 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:52.770767    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:53.121931 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:53.121896    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:53.808780 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:53.808751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:55.161000 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:55.160965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:55.244670 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:55.244630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:55.313358 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:55.313333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:55.761887 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:55.761854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:55.974115 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:55.974086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:02:56.071349 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:02:56.071277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:02.328430 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:02.328398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:03:31.515078 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:31.515044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:31.616870 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:31.616834    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:31.717412 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:31.717382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:34.513786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:34.513747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:03:36.046928 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:36.046893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:37.344684 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:37.344657    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:37.539743 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:37.539713    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:37.766399 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:37.766364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:38.056999 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:38.056924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:38.425254 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:38.425226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:40.421180 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:40.421150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:40.518523 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:40.518496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:40.660213 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:40.660186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:40.776185 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:40.776118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:41.297945 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:41.297913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:41.394567 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:41.394536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:03:45.720865 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:45.720829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:03:46.920271 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:03:46.920237    2560 scope.go:117] "RemoveContainer" containerID="b6d9ad5358576fcf42e66580c87892287c996825204d2fa19f46e241b72b132c"
Jul 24 20:04:15.827183 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:15.827134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:15.918775 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:15.918741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:16.023065 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:16.023032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:18.714269 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:18.714236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:04:20.379875 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:20.379836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:20.529877 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:20.529843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:20.761479 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:20.761428    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:21.258567 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:21.258528    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:21.355316 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:21.355294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:21.456578 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:21.456551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:22.844789 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:22.844747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:29.117233 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:29.117203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:29.233149 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:29.233120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:29.317017 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:29.316990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:29.416433 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:29.416408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:29.806281 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:29.806202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:04:55.777299 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:04:55.777266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:02.417135 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:02.417102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:02.520882 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:02.520842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:02.622359 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:02.622332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:18.522423 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:18.522389    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:24.527999 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:24.527964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:24.619346 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:24.619315    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:30.062770 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:30.062734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:35.154778 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:35.154747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:35.928855 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:35.928823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:43.527822 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:43.527780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:43.594474 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:43.594432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:43.708062 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:43.708025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:43.805912 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:43.805827    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:44.580626 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:44.580597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:44.669882 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:44.669849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:44.773182 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:44.773149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:46.115922 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:46.115888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:05:46.365019 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:46.364985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:52.080851 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:52.080821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:52.155021 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:52.154992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:52.831060 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:52.831026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:58.221016 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:58.220978    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:05:58.898637 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:58.898606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:59.000341 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:59.000309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:59.132059 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:59.132034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:05:59.450312 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:05:59.450273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:00.010045 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:00.010011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:01.581878 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:01.581833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:01.682529 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:01.682505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:02.827010 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:02.826959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:02.907872 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:02.907826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:02.982719 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:02.982683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:03.215854 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:03.215821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:03.612022 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:03.611948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:03.698586 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:03.698551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:07.209774 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:07.209743    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:07.842420 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:07.842388    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:07.949395 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:07.949375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:08.265549 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:08.265526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:09.914936 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:09.914901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:06:13.805698 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:13.805653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:13.906362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:13.906335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:24.604035 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:24.604002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:24.677043 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:24.677007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:24.733897 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:24.733869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:27.607717 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:27.607684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:06:29.230028 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:29.229988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:29.609353 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:29.609273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:35.298894 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:35.298854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:35.355259 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:35.355232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:35.561211 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:35.561158    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:35.780598 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:35.780547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:35.899895 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:35.899816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:35.997705 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:35.997650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:36.106651 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:36.106616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:41.634616 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:41.634583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:41.735378 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:41.735350    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:41.833155 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:41.833130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:41.968231 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:41.968196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:47.786971 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:47.786935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:47.842010 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:47.841985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:54.508137 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:54.508103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:54.805547 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:54.805474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:54.920429 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:54.920396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:57.998877 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:57.998840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:58.105094 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:58.105053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:58.196049 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:58.196020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:58.524824 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:58.524790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:58.776769 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:58.776699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:06:58.879730 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:06:58.879701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:07:02.502155 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:02.502125    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:07:03.419493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:03.419451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:07:20.206923 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.206880    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"]
Jul 24 20:07:20.207447 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.207426    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26082794-50aa-4336-b602-0b0f763c7ce3" containerName="main"
Jul 24 20:07:20.207556 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.207450    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="26082794-50aa-4336-b602-0b0f763c7ce3" containerName="main"
Jul 24 20:07:20.207556 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.207521    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a514c18-ac68-4032-9d97-98ca7af28f24" containerName="main"
Jul 24 20:07:20.207556 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.207530    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a514c18-ac68-4032-9d97-98ca7af28f24" containerName="main"
Jul 24 20:07:20.207767 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.207664    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="26082794-50aa-4336-b602-0b0f763c7ce3" containerName="main"
Jul 24 20:07:20.207767 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.207677    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a514c18-ac68-4032-9d97-98ca7af28f24" containerName="main"
Jul 24 20:07:20.217743 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.217708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"]
Jul 24 20:07:20.217854 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.217761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.220687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.220666    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-74e2adbb\"/\"openshift-service-ca.crt\""
Jul 24 20:07:20.221842 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.221818    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-74e2adbb\"/\"kube-root-ca.crt\""
Jul 24 20:07:20.221842 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.221819    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-74e2adbb\"/\"default-dockercfg-tgdpn\""
Jul 24 20:07:20.222044 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.221864    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-74e2adbb\"/\"e2e-lifecycle-model-74e2adbb-kserve-self-signed-certs\""
Jul 24 20:07:20.239213 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.239185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:07:20.343795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.343768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrgg\" (UniqueName: \"kubernetes.io/projected/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-kube-api-access-bjrgg\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.343914 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.343800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tmp-dir\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.343914 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.343839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-dshm\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.343996 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.343928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-model-cache\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.343996 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.343973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-home\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.344090 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.343996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tls-certs\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444435 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-dshm\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444580 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-model-cache\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444580 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-home\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444700 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tls-certs\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444700 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrgg\" (UniqueName: \"kubernetes.io/projected/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-kube-api-access-bjrgg\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444700 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tmp-dir\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.444929 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-home\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.445008 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.444938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tmp-dir\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.445064 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.445006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-model-cache\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.446626 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.446606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-dshm\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.446880 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.446865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tls-certs\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.453572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.453549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrgg\" (UniqueName: \"kubernetes.io/projected/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-kube-api-access-bjrgg\") pod \"e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") " pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.527941 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.527886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:20.653532 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:20.653511    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"]
Jul 24 20:07:20.655264 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:07:20.655241    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b1133d4_6c96_49e3_ad84_aadcdfe2426b.slice/crio-23e510578df1a7adfda2b424bde380cae81ad0e9d8612893ce6eb1e831b2a756 WatchSource:0}: Error finding container 23e510578df1a7adfda2b424bde380cae81ad0e9d8612893ce6eb1e831b2a756: Status 404 returned error can't find the container with id 23e510578df1a7adfda2b424bde380cae81ad0e9d8612893ce6eb1e831b2a756
Jul 24 20:07:21.200615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:21.200574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6" event={"ID":"4b1133d4-6c96-49e3-ad84-aadcdfe2426b","Type":"ContainerStarted","Data":"05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226"}
Jul 24 20:07:21.200615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:21.200621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6" event={"ID":"4b1133d4-6c96-49e3-ad84-aadcdfe2426b","Type":"ContainerStarted","Data":"23e510578df1a7adfda2b424bde380cae81ad0e9d8612893ce6eb1e831b2a756"}
Jul 24 20:07:21.217411 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:21.217327    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6" podStartSLOduration=1.217303204 podStartE2EDuration="1.217303204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:07:21.216871525 +0000 UTC m=+1954.861134567" watchObservedRunningTime="2026-07-24 20:07:21.217303204 +0000 UTC m=+1954.861566248"
Jul 24 20:07:23.609490 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:23.608543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:07:30.528152 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:30.528105    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:30.528790 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:30.528166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:30.540368 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:30.540345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:31.260384 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:31.260346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:07:52.618927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:07:52.618850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:08:11.220447 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:11.220411    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:08:12.792378 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:12.792348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:14.008585 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:14.008558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:17.403110 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:17.403073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:20.415686 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:20.415654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:08:20.582979 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:20.582946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:25.566324 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:25.566288    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"]
Jul 24 20:08:25.662123 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:25.662089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:31.891896 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:31.891864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:31.941589 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:31.941559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:40.586472 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.586421    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6" podUID="4b1133d4-6c96-49e3-ad84-aadcdfe2426b" containerName="main" containerID="cri-o://05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226" gracePeriod=45
Jul 24 20:08:40.836919 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.836860    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:08:40.893881 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.893858    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-dshm\") pod \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") "
Jul 24 20:08:40.894027 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.893891    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-model-cache\") pod \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") "
Jul 24 20:08:40.894027 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.893931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tls-certs\") pod \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") "
Jul 24 20:08:40.894027 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.893973    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tmp-dir\") pod \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") "
Jul 24 20:08:40.894027 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.893992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-home\") pod \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") "
Jul 24 20:08:40.894027 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894012    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjrgg\" (UniqueName: \"kubernetes.io/projected/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-kube-api-access-bjrgg\") pod \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\" (UID: \"4b1133d4-6c96-49e3-ad84-aadcdfe2426b\") "
Jul 24 20:08:40.894292 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b1133d4-6c96-49e3-ad84-aadcdfe2426b" (UID: "4b1133d4-6c96-49e3-ad84-aadcdfe2426b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:40.894292 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b1133d4-6c96-49e3-ad84-aadcdfe2426b" (UID: "4b1133d4-6c96-49e3-ad84-aadcdfe2426b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:40.894292 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894276    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-home" (OuterVolumeSpecName: "home") pod "4b1133d4-6c96-49e3-ad84-aadcdfe2426b" (UID: "4b1133d4-6c96-49e3-ad84-aadcdfe2426b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:40.894439 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894418    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:08:40.894501 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894442    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:08:40.894501 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.894471    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:08:40.896215 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.896187    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-kube-api-access-bjrgg" (OuterVolumeSpecName: "kube-api-access-bjrgg") pod "4b1133d4-6c96-49e3-ad84-aadcdfe2426b" (UID: "4b1133d4-6c96-49e3-ad84-aadcdfe2426b"). InnerVolumeSpecName "kube-api-access-bjrgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:08:40.896327 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.896311    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-dshm" (OuterVolumeSpecName: "dshm") pod "4b1133d4-6c96-49e3-ad84-aadcdfe2426b" (UID: "4b1133d4-6c96-49e3-ad84-aadcdfe2426b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:08:40.896371 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.896329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b1133d4-6c96-49e3-ad84-aadcdfe2426b" (UID: "4b1133d4-6c96-49e3-ad84-aadcdfe2426b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:08:40.995065 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.995042    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:08:40.995065 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.995064    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjrgg\" (UniqueName: \"kubernetes.io/projected/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-kube-api-access-bjrgg\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:08:40.995194 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:40.995073    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1133d4-6c96-49e3-ad84-aadcdfe2426b-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:08:41.600109 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.600079    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b1133d4-6c96-49e3-ad84-aadcdfe2426b" containerID="05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226" exitCode=0
Jul 24 20:08:41.600557 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.600120    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"
Jul 24 20:08:41.600557 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.600155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6" event={"ID":"4b1133d4-6c96-49e3-ad84-aadcdfe2426b","Type":"ContainerDied","Data":"05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226"}
Jul 24 20:08:41.600557 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.600185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6" event={"ID":"4b1133d4-6c96-49e3-ad84-aadcdfe2426b","Type":"ContainerDied","Data":"23e510578df1a7adfda2b424bde380cae81ad0e9d8612893ce6eb1e831b2a756"}
Jul 24 20:08:41.600557 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.600202    2560 scope.go:117] "RemoveContainer" containerID="05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226"
Jul 24 20:08:41.609564 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.609545    2560 scope.go:117] "RemoveContainer" containerID="05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226"
Jul 24 20:08:41.609834 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:08:41.609815    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226\": container with ID starting with 05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226 not found: ID does not exist" containerID="05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226"
Jul 24 20:08:41.609891 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.609843    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226"} err="failed to get container status \"05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226\": rpc error: code = NotFound desc = could not find container \"05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226\": container with ID starting with 05e50fd950b470651a96e094682dc25c42ddcdb3125620b46f8f11dcd152e226 not found: ID does not exist"
Jul 24 20:08:41.620712 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.620687    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"]
Jul 24 20:08:41.624286 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:41.624265    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-74e2adbb/e2e-lifecycle-model-74e2adbb-kserve-59ffffb7-2pbc6"]
Jul 24 20:08:42.276842 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:42.276811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:08:42.843013 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:08:42.842975    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b1133d4-6c96-49e3-ad84-aadcdfe2426b" path="/var/lib/kubelet/pods/4b1133d4-6c96-49e3-ad84-aadcdfe2426b/volumes"
Jul 24 20:09:01.851413 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:01.851381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:02.841409 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:02.841367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:08.247625 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:08.247593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:08.347769 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:08.347739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:08.534549 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:08.534429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:08.753477 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:08.753418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:09.823019 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:09.822982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:09.919595 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:09.919568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:10.020518 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:10.020480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:10.726256 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:10.726209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:10.832216 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:10.832180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:10.964101 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:10.964036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:12.224672 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:12.224634    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:09:12.257914 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:12.257876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:17.754549 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:17.754518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:18.153636 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:18.153563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:18.253200 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:18.253177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:18.848527 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:18.848492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:24.826634 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:24.826603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:09:25.273083 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:25.273057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:25.376964 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:25.376940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:25.474875 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:25.474851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:36.033795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:36.033757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:36.358178 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:36.358099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:09:57.314664 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:09:57.314628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:04.327995 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:04.327956    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:04.388247 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:04.388221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:04.656107 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:04.656033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:04.998149 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:04.998121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:05.479907 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:05.479871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:07.954839 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:07.954808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:08.055670 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:08.055646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:08.245907 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:08.245837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:08.510916 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:08.510832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:08.724299 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:08.724269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:08.826584 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:08.826511    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:12.438661 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:12.438633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:12.768376 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:12.768302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:13.056753 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:13.056676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:13.451366 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:13.451335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:13.708252 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:13.708056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:10:16.031266 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.031233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:16.112953 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.112923    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:16.183893 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.183867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:16.782026 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.781985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:16.880662 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.880635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:16.916722 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.916694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"]
Jul 24 20:10:16.917061 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.917050    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b1133d4-6c96-49e3-ad84-aadcdfe2426b" containerName="main"
Jul 24 20:10:16.917115 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.917063    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b1133d4-6c96-49e3-ad84-aadcdfe2426b" containerName="main"
Jul 24 20:10:16.917154 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.917130    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b1133d4-6c96-49e3-ad84-aadcdfe2426b" containerName="main"
Jul 24 20:10:16.920168 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.920150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:16.922932 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.922914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-4c32d4-dockercfg-nzfts\""
Jul 24 20:10:16.923044 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.922960    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-4c32d4\""
Jul 24 20:10:16.930484 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.930386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"]
Jul 24 20:10:16.932724 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.932701    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"]
Jul 24 20:10:16.936070 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.936054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:16.947443 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.947421    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"]
Jul 24 20:10:16.967294 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:16.967269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:17.079630 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.079572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxdc6\" (UniqueName: \"kubernetes.io/projected/05520b57-e653-4c61-acbb-e28ff0906f4d-kube-api-access-hxdc6\") pod \"payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.079630 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.079608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3631872b-3a5a-469a-b946-24e451fafb17-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.079966 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.079643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05520b57-e653-4c61-acbb-e28ff0906f4d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.079966 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.079692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wk9l\" (UniqueName: \"kubernetes.io/projected/3631872b-3a5a-469a-b946-24e451fafb17-kube-api-access-7wk9l\") pod \"payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.180522 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.180488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wk9l\" (UniqueName: \"kubernetes.io/projected/3631872b-3a5a-469a-b946-24e451fafb17-kube-api-access-7wk9l\") pod \"payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.180659 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.180603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxdc6\" (UniqueName: \"kubernetes.io/projected/05520b57-e653-4c61-acbb-e28ff0906f4d-kube-api-access-hxdc6\") pod \"payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.180659 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.180630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3631872b-3a5a-469a-b946-24e451fafb17-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.180762 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.180658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05520b57-e653-4c61-acbb-e28ff0906f4d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.181367 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.181344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3631872b-3a5a-469a-b946-24e451fafb17-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.181471 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.181343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05520b57-e653-4c61-acbb-e28ff0906f4d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.189532 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.189505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wk9l\" (UniqueName: \"kubernetes.io/projected/3631872b-3a5a-469a-b946-24e451fafb17-kube-api-access-7wk9l\") pod \"payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.189633 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.189512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxdc6\" (UniqueName: \"kubernetes.io/projected/05520b57-e653-4c61-acbb-e28ff0906f4d-kube-api-access-hxdc6\") pod \"payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.231411 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.231388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:17.247362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.247344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:17.375960 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.375861    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"]
Jul 24 20:10:17.378082 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:10:17.378051    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3631872b_3a5a_469a_b946_24e451fafb17.slice/crio-b2e185b8813914bb250c6de39e56d83de4e5ddd9a5799ff4152092d0f91ce423 WatchSource:0}: Error finding container b2e185b8813914bb250c6de39e56d83de4e5ddd9a5799ff4152092d0f91ce423: Status 404 returned error can't find the container with id b2e185b8813914bb250c6de39e56d83de4e5ddd9a5799ff4152092d0f91ce423
Jul 24 20:10:17.403807 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:17.403787    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"]
Jul 24 20:10:17.407599 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:10:17.407573    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05520b57_e653_4c61_acbb_e28ff0906f4d.slice/crio-0c9dad92ea56f221ab16e6352def591d30f306fa5ede7e916760889f344f770b WatchSource:0}: Error finding container 0c9dad92ea56f221ab16e6352def591d30f306fa5ede7e916760889f344f770b: Status 404 returned error can't find the container with id 0c9dad92ea56f221ab16e6352def591d30f306fa5ede7e916760889f344f770b
Jul 24 20:10:18.059206 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.059173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c" event={"ID":"3631872b-3a5a-469a-b946-24e451fafb17","Type":"ContainerStarted","Data":"559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919"}
Jul 24 20:10:18.059424 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.059233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c" event={"ID":"3631872b-3a5a-469a-b946-24e451fafb17","Type":"ContainerStarted","Data":"b2e185b8813914bb250c6de39e56d83de4e5ddd9a5799ff4152092d0f91ce423"}
Jul 24 20:10:18.059424 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.059264    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:18.060772 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.060749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm" event={"ID":"05520b57-e653-4c61-acbb-e28ff0906f4d","Type":"ContainerStarted","Data":"85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7"}
Jul 24 20:10:18.060871 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.060785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm" event={"ID":"05520b57-e653-4c61-acbb-e28ff0906f4d","Type":"ContainerStarted","Data":"0c9dad92ea56f221ab16e6352def591d30f306fa5ede7e916760889f344f770b"}
Jul 24 20:10:18.060871 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.060812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:18.076203 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.076163    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c" podStartSLOduration=2.076150224 podStartE2EDuration="2.076150224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:18.073836352 +0000 UTC m=+2131.718099393" watchObservedRunningTime="2026-07-24 20:10:18.076150224 +0000 UTC m=+2131.720413264"
Jul 24 20:10:18.089554 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:18.089516    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm" podStartSLOduration=2.089503053 podStartE2EDuration="2.089503053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:18.087892604 +0000 UTC m=+2131.732155647" watchObservedRunningTime="2026-07-24 20:10:18.089503053 +0000 UTC m=+2131.733766092"
Jul 24 20:10:20.514140 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:20.514102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:26.705222 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:26.705183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:10:29.067320 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.067289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:10:29.067939 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.067650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:10:29.396753 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.396672    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"]
Jul 24 20:10:29.400202 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.400181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.402765 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.402742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-05f5d4\"/\"test-model-05f5d4-kserve-self-signed-certs\""
Jul 24 20:10:29.402982 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.402966    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-05f5d4\"/\"kube-root-ca.crt\""
Jul 24 20:10:29.403040 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.402988    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-05f5d4\"/\"openshift-service-ca.crt\""
Jul 24 20:10:29.403951 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.403937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-05f5d4\"/\"default-dockercfg-wq924\""
Jul 24 20:10:29.408947 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.408924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"]
Jul 24 20:10:29.432129 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.432103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:29.480641 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.480618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qr9\" (UniqueName: \"kubernetes.io/projected/3f12735f-8901-461e-94a2-8c3b3862a52d-kube-api-access-95qr9\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.480755 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.480651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-model-cache\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.480755 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.480676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-home\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.480837 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.480755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f12735f-8901-461e-94a2-8c3b3862a52d-tls-certs\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.480873 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.480831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-tmp-dir\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.480873 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.480856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-dshm\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581424 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-tmp-dir\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-dshm\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95qr9\" (UniqueName: \"kubernetes.io/projected/3f12735f-8901-461e-94a2-8c3b3862a52d-kube-api-access-95qr9\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-model-cache\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-home\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f12735f-8901-461e-94a2-8c3b3862a52d-tls-certs\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.581991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.581909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-tmp-dir\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.582102 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.582079    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-model-cache\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.582269 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.582242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-home\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.584431 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.584404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-dshm\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.584635 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.584618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f12735f-8901-461e-94a2-8c3b3862a52d-tls-certs\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.590062 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.590033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qr9\" (UniqueName: \"kubernetes.io/projected/3f12735f-8901-461e-94a2-8c3b3862a52d-kube-api-access-95qr9\") pod \"test-model-05f5d4-kserve-54c7bbd465-8f82j\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") " pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.712562 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.712530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:29.847577 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:29.847549    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"]
Jul 24 20:10:29.851327 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:10:29.851302    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f12735f_8901_461e_94a2_8c3b3862a52d.slice/crio-0120e112a58b690546c12b65ab7d3fb3e73f2b18eb173d47ce9d49e719754ed1 WatchSource:0}: Error finding container 0120e112a58b690546c12b65ab7d3fb3e73f2b18eb173d47ce9d49e719754ed1: Status 404 returned error can't find the container with id 0120e112a58b690546c12b65ab7d3fb3e73f2b18eb173d47ce9d49e719754ed1
Jul 24 20:10:30.120826 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:30.120701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j" event={"ID":"3f12735f-8901-461e-94a2-8c3b3862a52d","Type":"ContainerStarted","Data":"2b077c58b81b5af72a6a8dc027f4d43afd07262a1668ae1233a3122750c65601"}
Jul 24 20:10:30.120826 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:30.120741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j" event={"ID":"3f12735f-8901-461e-94a2-8c3b3862a52d","Type":"ContainerStarted","Data":"0120e112a58b690546c12b65ab7d3fb3e73f2b18eb173d47ce9d49e719754ed1"}
Jul 24 20:10:30.138247 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:30.138205    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j" podStartSLOduration=1.138187068 podStartE2EDuration="1.138187068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:30.135979123 +0000 UTC m=+2143.780242176" watchObservedRunningTime="2026-07-24 20:10:30.138187068 +0000 UTC m=+2143.782450109"
Jul 24 20:10:34.825528 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:34.825491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:10:39.713529 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:39.713285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:39.713529 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:39.713396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:39.729395 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:39.729315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:40.178563 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:40.178532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:10:48.812029 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.811992    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"]
Jul 24 20:10:48.816692 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.816666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:48.819769 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.819744    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4c32d4\"/\"openshift-service-ca.crt\""
Jul 24 20:10:48.820817 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.820766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4c32d4\"/\"default-dockercfg-s5cqq\""
Jul 24 20:10:48.821324 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.820823    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4c32d4\"/\"kube-root-ca.crt\""
Jul 24 20:10:48.821448 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.821359    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4c32d4\"/\"test-model-4c32d4-kserve-self-signed-certs\""
Jul 24 20:10:48.824990 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.824964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"]
Jul 24 20:10:48.854753 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.854725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:10:48.952447 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.952422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vt8n\" (UniqueName: \"kubernetes.io/projected/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-kube-api-access-2vt8n\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:48.952563 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.952504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-model-cache\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:48.952609 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.952563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tmp-dir\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:48.952609 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.952590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-dshm\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:48.952675 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.952642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tls-certs\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:48.952713 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:48.952681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-home\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053214 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tls-certs\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053309 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-home\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053309 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vt8n\" (UniqueName: \"kubernetes.io/projected/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-kube-api-access-2vt8n\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053309 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-model-cache\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053480 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tmp-dir\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053480 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-dshm\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053680 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-home\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053739 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-model-cache\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.053791 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.053732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tmp-dir\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.055552 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.055527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-dshm\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.055816 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.055800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tls-certs\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.062002 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.061983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vt8n\" (UniqueName: \"kubernetes.io/projected/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-kube-api-access-2vt8n\") pod \"test-model-4c32d4-kserve-656fbdcf7-lqhnd\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") " pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.129173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.129122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:49.258434 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:49.258411    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"]
Jul 24 20:10:49.260888 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:10:49.260861    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63c2bc8b_d892_4964_b0a6_53a0cbdcb370.slice/crio-55fadc0ce6aa124619164b744c98c304e45d854a8c7687a0bb7a2b388af473c8 WatchSource:0}: Error finding container 55fadc0ce6aa124619164b744c98c304e45d854a8c7687a0bb7a2b388af473c8: Status 404 returned error can't find the container with id 55fadc0ce6aa124619164b744c98c304e45d854a8c7687a0bb7a2b388af473c8
Jul 24 20:10:50.216247 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:50.216210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd" event={"ID":"63c2bc8b-d892-4964-b0a6-53a0cbdcb370","Type":"ContainerStarted","Data":"7c026c3a739ebd0db90cc173f227e75944f96e3a7693ebf8e3f2a410858fedd0"}
Jul 24 20:10:50.216625 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:50.216255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd" event={"ID":"63c2bc8b-d892-4964-b0a6-53a0cbdcb370","Type":"ContainerStarted","Data":"55fadc0ce6aa124619164b744c98c304e45d854a8c7687a0bb7a2b388af473c8"}
Jul 24 20:10:50.233830 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:50.233783    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd" podStartSLOduration=2.233768334 podStartE2EDuration="2.233768334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:10:50.23159657 +0000 UTC m=+2163.875859622" watchObservedRunningTime="2026-07-24 20:10:50.233768334 +0000 UTC m=+2163.878031374"
Jul 24 20:10:53.112183 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:53.112151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:10:59.129567 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:59.129532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:59.129964 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:59.129857    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:59.141855 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:59.141824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:10:59.276035 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:10:59.276005    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:11:06.818418 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:06.818377    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:11:30.312171 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:30.312133    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"]
Jul 24 20:11:30.336595 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:30.336564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:31.316773 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:31.316736    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"]
Jul 24 20:11:31.337726 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:31.337700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:35.019400 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:35.019364    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:11:42.004566 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:42.004526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:42.070183 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:42.070155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:42.131831 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:42.131800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:45.330820 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.330784    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j" podUID="3f12735f-8901-461e-94a2-8c3b3862a52d" containerName="main" containerID="cri-o://2b077c58b81b5af72a6a8dc027f4d43afd07262a1668ae1233a3122750c65601" gracePeriod=45
Jul 24 20:11:45.505191 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.505162    2560 generic.go:356] "Generic (PLEG): container finished" podID="3f12735f-8901-461e-94a2-8c3b3862a52d" containerID="2b077c58b81b5af72a6a8dc027f4d43afd07262a1668ae1233a3122750c65601" exitCode=0
Jul 24 20:11:45.505318 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.505231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j" event={"ID":"3f12735f-8901-461e-94a2-8c3b3862a52d","Type":"ContainerDied","Data":"2b077c58b81b5af72a6a8dc027f4d43afd07262a1668ae1233a3122750c65601"}
Jul 24 20:11:45.580031 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.580010    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:11:45.641971 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.641899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95qr9\" (UniqueName: \"kubernetes.io/projected/3f12735f-8901-461e-94a2-8c3b3862a52d-kube-api-access-95qr9\") pod \"3f12735f-8901-461e-94a2-8c3b3862a52d\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") "
Jul 24 20:11:45.641971 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.641952    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-tmp-dir\") pod \"3f12735f-8901-461e-94a2-8c3b3862a52d\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") "
Jul 24 20:11:45.642173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.641988    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f12735f-8901-461e-94a2-8c3b3862a52d-tls-certs\") pod \"3f12735f-8901-461e-94a2-8c3b3862a52d\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") "
Jul 24 20:11:45.642173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642022    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-dshm\") pod \"3f12735f-8901-461e-94a2-8c3b3862a52d\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") "
Jul 24 20:11:45.642173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-home\") pod \"3f12735f-8901-461e-94a2-8c3b3862a52d\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") "
Jul 24 20:11:45.642173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642086    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-model-cache\") pod \"3f12735f-8901-461e-94a2-8c3b3862a52d\" (UID: \"3f12735f-8901-461e-94a2-8c3b3862a52d\") "
Jul 24 20:11:45.642377 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642259    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f12735f-8901-461e-94a2-8c3b3862a52d" (UID: "3f12735f-8901-461e-94a2-8c3b3862a52d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:45.642377 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-home" (OuterVolumeSpecName: "home") pod "3f12735f-8901-461e-94a2-8c3b3862a52d" (UID: "3f12735f-8901-461e-94a2-8c3b3862a52d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:45.642521 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642410    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f12735f-8901-461e-94a2-8c3b3862a52d" (UID: "3f12735f-8901-461e-94a2-8c3b3862a52d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:45.642521 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.642496    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:45.644235 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.644215    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-dshm" (OuterVolumeSpecName: "dshm") pod "3f12735f-8901-461e-94a2-8c3b3862a52d" (UID: "3f12735f-8901-461e-94a2-8c3b3862a52d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:45.644309 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.644254    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f12735f-8901-461e-94a2-8c3b3862a52d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f12735f-8901-461e-94a2-8c3b3862a52d" (UID: "3f12735f-8901-461e-94a2-8c3b3862a52d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:11:45.644352 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.644335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f12735f-8901-461e-94a2-8c3b3862a52d-kube-api-access-95qr9" (OuterVolumeSpecName: "kube-api-access-95qr9") pod "3f12735f-8901-461e-94a2-8c3b3862a52d" (UID: "3f12735f-8901-461e-94a2-8c3b3862a52d"). InnerVolumeSpecName "kube-api-access-95qr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:11:45.743879 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.743849    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:45.743879 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.743870    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:45.743879 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.743880    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f12735f-8901-461e-94a2-8c3b3862a52d-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:45.744074 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.743890    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95qr9\" (UniqueName: \"kubernetes.io/projected/3f12735f-8901-461e-94a2-8c3b3862a52d-kube-api-access-95qr9\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:45.744074 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:45.743898    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f12735f-8901-461e-94a2-8c3b3862a52d-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.336035 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.335995    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd" podUID="63c2bc8b-d892-4964-b0a6-53a0cbdcb370" containerName="main" containerID="cri-o://7c026c3a739ebd0db90cc173f227e75944f96e3a7693ebf8e3f2a410858fedd0" gracePeriod=45
Jul 24 20:11:46.511557 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.511534    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"
Jul 24 20:11:46.511709 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.511534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j" event={"ID":"3f12735f-8901-461e-94a2-8c3b3862a52d","Type":"ContainerDied","Data":"0120e112a58b690546c12b65ab7d3fb3e73f2b18eb173d47ce9d49e719754ed1"}
Jul 24 20:11:46.511709 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.511665    2560 scope.go:117] "RemoveContainer" containerID="2b077c58b81b5af72a6a8dc027f4d43afd07262a1668ae1233a3122750c65601"
Jul 24 20:11:46.513356 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.513306    2560 generic.go:356] "Generic (PLEG): container finished" podID="63c2bc8b-d892-4964-b0a6-53a0cbdcb370" containerID="7c026c3a739ebd0db90cc173f227e75944f96e3a7693ebf8e3f2a410858fedd0" exitCode=0
Jul 24 20:11:46.513491 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.513380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd" event={"ID":"63c2bc8b-d892-4964-b0a6-53a0cbdcb370","Type":"ContainerDied","Data":"7c026c3a739ebd0db90cc173f227e75944f96e3a7693ebf8e3f2a410858fedd0"}
Jul 24 20:11:46.538502 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.538474    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"]
Jul 24 20:11:46.539385 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.539358    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:46.540943 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.540924    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-05f5d4/test-model-05f5d4-kserve-54c7bbd465-8f82j"]
Jul 24 20:11:46.595922 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.595870    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:11:46.654718 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.654694    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vt8n\" (UniqueName: \"kubernetes.io/projected/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-kube-api-access-2vt8n\") pod \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") "
Jul 24 20:11:46.654843 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.654750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tmp-dir\") pod \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") "
Jul 24 20:11:46.654843 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.654802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-home\") pod \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") "
Jul 24 20:11:46.654915 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.654851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tls-certs\") pod \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") "
Jul 24 20:11:46.654915 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.654873    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-model-cache\") pod \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") "
Jul 24 20:11:46.654915 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.654906    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-dshm\") pod \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\" (UID: \"63c2bc8b-d892-4964-b0a6-53a0cbdcb370\") "
Jul 24 20:11:46.655069 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.655039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63c2bc8b-d892-4964-b0a6-53a0cbdcb370" (UID: "63c2bc8b-d892-4964-b0a6-53a0cbdcb370"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:46.655187 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.655162    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-model-cache" (OuterVolumeSpecName: "model-cache") pod "63c2bc8b-d892-4964-b0a6-53a0cbdcb370" (UID: "63c2bc8b-d892-4964-b0a6-53a0cbdcb370"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:46.655257 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.655196    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-home" (OuterVolumeSpecName: "home") pod "63c2bc8b-d892-4964-b0a6-53a0cbdcb370" (UID: "63c2bc8b-d892-4964-b0a6-53a0cbdcb370"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:46.655325 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.655302    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.655325 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.655326    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.656959 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.656935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-dshm" (OuterVolumeSpecName: "dshm") pod "63c2bc8b-d892-4964-b0a6-53a0cbdcb370" (UID: "63c2bc8b-d892-4964-b0a6-53a0cbdcb370"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:11:46.656959 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.656952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-kube-api-access-2vt8n" (OuterVolumeSpecName: "kube-api-access-2vt8n") pod "63c2bc8b-d892-4964-b0a6-53a0cbdcb370" (UID: "63c2bc8b-d892-4964-b0a6-53a0cbdcb370"). InnerVolumeSpecName "kube-api-access-2vt8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:11:46.657112 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.656988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63c2bc8b-d892-4964-b0a6-53a0cbdcb370" (UID: "63c2bc8b-d892-4964-b0a6-53a0cbdcb370"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:11:46.756750 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.756726    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.756750 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.756747    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.756750 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.756756    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.756965 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.756764    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vt8n\" (UniqueName: \"kubernetes.io/projected/63c2bc8b-d892-4964-b0a6-53a0cbdcb370-kube-api-access-2vt8n\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:46.843493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.843448    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f12735f-8901-461e-94a2-8c3b3862a52d" path="/var/lib/kubelet/pods/3f12735f-8901-461e-94a2-8c3b3862a52d/volumes"
Jul 24 20:11:46.923913 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:46.923839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:47.520436 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:47.520403    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"
Jul 24 20:11:47.520436 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:47.520410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd" event={"ID":"63c2bc8b-d892-4964-b0a6-53a0cbdcb370","Type":"ContainerDied","Data":"55fadc0ce6aa124619164b744c98c304e45d854a8c7687a0bb7a2b388af473c8"}
Jul 24 20:11:47.521037 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:47.520493    2560 scope.go:117] "RemoveContainer" containerID="7c026c3a739ebd0db90cc173f227e75944f96e3a7693ebf8e3f2a410858fedd0"
Jul 24 20:11:47.537553 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:47.537528    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"]
Jul 24 20:11:47.541546 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:47.541519    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4c32d4/test-model-4c32d4-kserve-656fbdcf7-lqhnd"]
Jul 24 20:11:48.843020 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:48.842990    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c2bc8b-d892-4964-b0a6-53a0cbdcb370" path="/var/lib/kubelet/pods/63c2bc8b-d892-4964-b0a6-53a0cbdcb370/volumes"
Jul 24 20:11:50.523098 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:50.523053    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:11:52.850305 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:52.850266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:52.989200 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:52.989171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:53.163121 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.163096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:53.382831 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.382799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:11:53.500062 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.499974    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"]
Jul 24 20:11:53.500486 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.500450    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f12735f-8901-461e-94a2-8c3b3862a52d" containerName="main"
Jul 24 20:11:53.500486 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.500485    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f12735f-8901-461e-94a2-8c3b3862a52d" containerName="main"
Jul 24 20:11:53.500634 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.500497    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c2bc8b-d892-4964-b0a6-53a0cbdcb370" containerName="main"
Jul 24 20:11:53.500634 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.500505    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c2bc8b-d892-4964-b0a6-53a0cbdcb370" containerName="main"
Jul 24 20:11:53.500634 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.500619    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f12735f-8901-461e-94a2-8c3b3862a52d" containerName="main"
Jul 24 20:11:53.500634 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.500634    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c2bc8b-d892-4964-b0a6-53a0cbdcb370" containerName="main"
Jul 24 20:11:53.503750 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.503731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:53.506544 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.506526    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:11:53.506623 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.506527    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:11:53.511367 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.511342    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"]
Jul 24 20:11:53.621586 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.621551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7\" (UID: \"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:53.722937 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.722904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7\" (UID: \"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:53.723504 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.723488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7\" (UID: \"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:53.814914 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.814855    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:53.947432 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:53.947278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"]
Jul 24 20:11:53.950128 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:11:53.950101    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7d8cd7_7cb2_4a62_960d_8f46fe2fad11.slice/crio-70584489ea88fc1dfd3ec5e09138fe727bff8dfa67ab0d7d4b05b787181aa740 WatchSource:0}: Error finding container 70584489ea88fc1dfd3ec5e09138fe727bff8dfa67ab0d7d4b05b787181aa740: Status 404 returned error can't find the container with id 70584489ea88fc1dfd3ec5e09138fe727bff8dfa67ab0d7d4b05b787181aa740
Jul 24 20:11:54.560821 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:54.560789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7" event={"ID":"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11","Type":"ContainerStarted","Data":"f1a66b1343ffc839262af4776fbf8b1fafd03d61c23d78198993856bd45f62ad"}
Jul 24 20:11:54.560934 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:54.560845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7" event={"ID":"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11","Type":"ContainerStarted","Data":"70584489ea88fc1dfd3ec5e09138fe727bff8dfa67ab0d7d4b05b787181aa740"}
Jul 24 20:11:55.566708 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:55.566675    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11" containerID="f1a66b1343ffc839262af4776fbf8b1fafd03d61c23d78198993856bd45f62ad" exitCode=0
Jul 24 20:11:55.567100 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:55.566767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7" event={"ID":"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11","Type":"ContainerDied","Data":"f1a66b1343ffc839262af4776fbf8b1fafd03d61c23d78198993856bd45f62ad"}
Jul 24 20:11:55.698061 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:55.698039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:55.843181 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:55.843099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11-maas-api-service-ca\") pod \"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11\" (UID: \"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11\") "
Jul 24 20:11:55.843496 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:55.843452    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11" (UID: "ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:11:55.944699 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:55.944667    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11-maas-api-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:11:56.572913 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:56.572885    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"
Jul 24 20:11:56.573291 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:56.572922    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7" event={"ID":"ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11","Type":"ContainerDied","Data":"70584489ea88fc1dfd3ec5e09138fe727bff8dfa67ab0d7d4b05b787181aa740"}
Jul 24 20:11:56.573291 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:11:56.572966    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70584489ea88fc1dfd3ec5e09138fe727bff8dfa67ab0d7d4b05b787181aa740"
Jul 24 20:12:03.992223 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:03.992173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:04.028645 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.028611    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"]
Jul 24 20:12:04.029150 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.029118    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm" podUID="05520b57-e653-4c61-acbb-e28ff0906f4d" containerName="payload-processing" containerID="cri-o://85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7" gracePeriod=30
Jul 24 20:12:04.033419 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.033385    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"]
Jul 24 20:12:04.033875 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.033810    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c" podUID="3631872b-3a5a-469a-b946-24e451fafb17" containerName="payload-pre-processing" containerID="cri-o://559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919" gracePeriod=30
Jul 24 20:12:04.068955 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.068930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:04.137099 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.137072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:04.306879 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.306854    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:12:04.309803 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.309782    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:12:04.427474 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.427438    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3631872b-3a5a-469a-b946-24e451fafb17-plugins-config-volume\") pod \"3631872b-3a5a-469a-b946-24e451fafb17\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") "
Jul 24 20:12:04.427599 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.427551    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05520b57-e653-4c61-acbb-e28ff0906f4d-plugins-config-volume\") pod \"05520b57-e653-4c61-acbb-e28ff0906f4d\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") "
Jul 24 20:12:04.427599 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.427583    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wk9l\" (UniqueName: \"kubernetes.io/projected/3631872b-3a5a-469a-b946-24e451fafb17-kube-api-access-7wk9l\") pod \"3631872b-3a5a-469a-b946-24e451fafb17\" (UID: \"3631872b-3a5a-469a-b946-24e451fafb17\") "
Jul 24 20:12:04.427701 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.427612    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxdc6\" (UniqueName: \"kubernetes.io/projected/05520b57-e653-4c61-acbb-e28ff0906f4d-kube-api-access-hxdc6\") pod \"05520b57-e653-4c61-acbb-e28ff0906f4d\" (UID: \"05520b57-e653-4c61-acbb-e28ff0906f4d\") "
Jul 24 20:12:04.427831 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.427805    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3631872b-3a5a-469a-b946-24e451fafb17-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3631872b-3a5a-469a-b946-24e451fafb17" (UID: "3631872b-3a5a-469a-b946-24e451fafb17"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:12:04.427998 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.427975    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05520b57-e653-4c61-acbb-e28ff0906f4d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05520b57-e653-4c61-acbb-e28ff0906f4d" (UID: "05520b57-e653-4c61-acbb-e28ff0906f4d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:12:04.430433 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.430413    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3631872b-3a5a-469a-b946-24e451fafb17-kube-api-access-7wk9l" (OuterVolumeSpecName: "kube-api-access-7wk9l") pod "3631872b-3a5a-469a-b946-24e451fafb17" (UID: "3631872b-3a5a-469a-b946-24e451fafb17"). InnerVolumeSpecName "kube-api-access-7wk9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:12:04.430566 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.430438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05520b57-e653-4c61-acbb-e28ff0906f4d-kube-api-access-hxdc6" (OuterVolumeSpecName: "kube-api-access-hxdc6") pod "05520b57-e653-4c61-acbb-e28ff0906f4d" (UID: "05520b57-e653-4c61-acbb-e28ff0906f4d"). InnerVolumeSpecName "kube-api-access-hxdc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:12:04.528802 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.528715    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3631872b-3a5a-469a-b946-24e451fafb17-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:12:04.528802 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.528747    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05520b57-e653-4c61-acbb-e28ff0906f4d-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:12:04.528802 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.528757    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wk9l\" (UniqueName: \"kubernetes.io/projected/3631872b-3a5a-469a-b946-24e451fafb17-kube-api-access-7wk9l\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:12:04.528802 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.528765    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxdc6\" (UniqueName: \"kubernetes.io/projected/05520b57-e653-4c61-acbb-e28ff0906f4d-kube-api-access-hxdc6\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:12:04.612040 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.612011    2560 generic.go:356] "Generic (PLEG): container finished" podID="05520b57-e653-4c61-acbb-e28ff0906f4d" containerID="85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7" exitCode=0
Jul 24 20:12:04.612201 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.612059    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"
Jul 24 20:12:04.612201 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.612096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm" event={"ID":"05520b57-e653-4c61-acbb-e28ff0906f4d","Type":"ContainerDied","Data":"85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7"}
Jul 24 20:12:04.612201 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.612144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm" event={"ID":"05520b57-e653-4c61-acbb-e28ff0906f4d","Type":"ContainerDied","Data":"0c9dad92ea56f221ab16e6352def591d30f306fa5ede7e916760889f344f770b"}
Jul 24 20:12:04.612201 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.612166    2560 scope.go:117] "RemoveContainer" containerID="85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7"
Jul 24 20:12:04.613620 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.613600    2560 generic.go:356] "Generic (PLEG): container finished" podID="3631872b-3a5a-469a-b946-24e451fafb17" containerID="559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919" exitCode=0
Jul 24 20:12:04.613756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.613630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c" event={"ID":"3631872b-3a5a-469a-b946-24e451fafb17","Type":"ContainerDied","Data":"559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919"}
Jul 24 20:12:04.613756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.613654    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"
Jul 24 20:12:04.613756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.613680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c" event={"ID":"3631872b-3a5a-469a-b946-24e451fafb17","Type":"ContainerDied","Data":"b2e185b8813914bb250c6de39e56d83de4e5ddd9a5799ff4152092d0f91ce423"}
Jul 24 20:12:04.622332 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.622313    2560 scope.go:117] "RemoveContainer" containerID="85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7"
Jul 24 20:12:04.622656 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:12:04.622634    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7\": container with ID starting with 85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7 not found: ID does not exist" containerID="85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7"
Jul 24 20:12:04.622720 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.622671    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7"} err="failed to get container status \"85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7\": rpc error: code = NotFound desc = could not find container \"85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7\": container with ID starting with 85f2a63d982cdc5f2cac6c655ae50c354e5acb7768b32c03c9e3c180b1981ab7 not found: ID does not exist"
Jul 24 20:12:04.622720 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.622687    2560 scope.go:117] "RemoveContainer" containerID="559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919"
Jul 24 20:12:04.631492 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.631452    2560 scope.go:117] "RemoveContainer" containerID="559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919"
Jul 24 20:12:04.631815 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:12:04.631796    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919\": container with ID starting with 559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919 not found: ID does not exist" containerID="559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919"
Jul 24 20:12:04.631855 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.631827    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919"} err="failed to get container status \"559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919\": rpc error: code = NotFound desc = could not find container \"559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919\": container with ID starting with 559c049c234b741c20007c77a14011bd0aaa19210c6bd55ce73a0e3dd7cb9919 not found: ID does not exist"
Jul 24 20:12:04.636669 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.636613    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"]
Jul 24 20:12:04.642481 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.642401    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-4c32d4-5cf4f89784-wd4pm"]
Jul 24 20:12:04.658070 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.658006    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"]
Jul 24 20:12:04.663188 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.663123    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4c32d4-7b4bf65cd8-cdp8c"]
Jul 24 20:12:04.846811 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.846606    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05520b57-e653-4c61-acbb-e28ff0906f4d" path="/var/lib/kubelet/pods/05520b57-e653-4c61-acbb-e28ff0906f4d/volumes"
Jul 24 20:12:04.847266 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:04.847243    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3631872b-3a5a-469a-b946-24e451fafb17" path="/var/lib/kubelet/pods/3631872b-3a5a-469a-b946-24e451fafb17/volumes"
Jul 24 20:12:06.919781 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:06.919750    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:12:08.580580 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:08.580497    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"]
Jul 24 20:12:08.583028 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:08.582997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:08.583435 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:08.583417    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c32d4-sthw7"]
Jul 24 20:12:08.842371 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:08.842304    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11" path="/var/lib/kubelet/pods/ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11/volumes"
Jul 24 20:12:08.973004 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:08.972979    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:15.078171 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:15.078136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:15.210857 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:15.210822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:15.424970 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:15.424942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:15.643786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:15.643759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:15.961569 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:15.961539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:16.277591 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:16.277510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:16.781992 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:16.781960    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:19.753295 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:19.753261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:19.823982 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:19.823952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:19.890828 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:19.890800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:20.239534 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:20.239509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:20.430253 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:20.430226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:20.524720 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:20.524644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:24.169257 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:24.169222    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:24.622483 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:24.622371    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:24.924214 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:24.924187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:25.083619 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:25.083595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:25.420773 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:25.420739    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:12:27.823494 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:27.823443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:27.920022 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:27.919996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:28.174376 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.174352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:28.250796 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.250765    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:28.696722 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.696688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:28.796768 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.796736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:28.803978 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.803951    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"]
Jul 24 20:12:28.804347 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804334    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3631872b-3a5a-469a-b946-24e451fafb17" containerName="payload-pre-processing"
Jul 24 20:12:28.804394 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804350    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3631872b-3a5a-469a-b946-24e451fafb17" containerName="payload-pre-processing"
Jul 24 20:12:28.804394 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804363    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05520b57-e653-4c61-acbb-e28ff0906f4d" containerName="payload-processing"
Jul 24 20:12:28.804394 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804369    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05520b57-e653-4c61-acbb-e28ff0906f4d" containerName="payload-processing"
Jul 24 20:12:28.804394 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804378    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11" containerName="revoke-keys"
Jul 24 20:12:28.804394 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804384    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11" containerName="revoke-keys"
Jul 24 20:12:28.804573 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804471    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3631872b-3a5a-469a-b946-24e451fafb17" containerName="payload-pre-processing"
Jul 24 20:12:28.804573 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804484    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05520b57-e653-4c61-acbb-e28ff0906f4d" containerName="payload-processing"
Jul 24 20:12:28.804573 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.804495    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7d8cd7-7cb2-4a62-960d-8f46fe2fad11" containerName="revoke-keys"
Jul 24 20:12:28.807537 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.807522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:28.809943 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.809921    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-247467\""
Jul 24 20:12:28.810050 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.809925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-247467-dockercfg-xkj7f\""
Jul 24 20:12:28.816612 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.816591    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"]
Jul 24 20:12:28.842886 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.842864    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"]
Jul 24 20:12:28.846075 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.846061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:28.852377 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.852358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"]
Jul 24 20:12:28.924358 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.924337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfba8c4d-d3de-4573-a25a-392e048b54cc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-247467-76fc6df478-42kj8\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") " pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:28.924477 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.924445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slxpz\" (UniqueName: \"kubernetes.io/projected/bfba8c4d-d3de-4573-a25a-392e048b54cc-kube-api-access-slxpz\") pod \"payload-processing-e2e-api-b-247467-76fc6df478-42kj8\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") " pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:28.924523 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.924486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0977e831-ba32-4fd1-9818-15767dd68c3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:28.924523 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:28.924512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnvl5\" (UniqueName: \"kubernetes.io/projected/0977e831-ba32-4fd1-9818-15767dd68c3a-kube-api-access-hnvl5\") pod \"payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.025294 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.025233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfba8c4d-d3de-4573-a25a-392e048b54cc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-247467-76fc6df478-42kj8\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") " pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:29.025404 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.025340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slxpz\" (UniqueName: \"kubernetes.io/projected/bfba8c4d-d3de-4573-a25a-392e048b54cc-kube-api-access-slxpz\") pod \"payload-processing-e2e-api-b-247467-76fc6df478-42kj8\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") " pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:29.025404 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.025370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0977e831-ba32-4fd1-9818-15767dd68c3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.025404 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.025394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnvl5\" (UniqueName: \"kubernetes.io/projected/0977e831-ba32-4fd1-9818-15767dd68c3a-kube-api-access-hnvl5\") pod \"payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.025997 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.025978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfba8c4d-d3de-4573-a25a-392e048b54cc-plugins-config-volume\") pod \"payload-processing-e2e-api-b-247467-76fc6df478-42kj8\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") " pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:29.025997 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.025993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0977e831-ba32-4fd1-9818-15767dd68c3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.032608 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.032583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slxpz\" (UniqueName: \"kubernetes.io/projected/bfba8c4d-d3de-4573-a25a-392e048b54cc-kube-api-access-slxpz\") pod \"payload-processing-e2e-api-b-247467-76fc6df478-42kj8\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") " pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:29.032800 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.032783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnvl5\" (UniqueName: \"kubernetes.io/projected/0977e831-ba32-4fd1-9818-15767dd68c3a-kube-api-access-hnvl5\") pod \"payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.118841 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.118812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.156154 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.156099    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:29.276362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.276172    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"]
Jul 24 20:12:29.278245 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:12:29.278209    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0977e831_ba32_4fd1_9818_15767dd68c3a.slice/crio-4df9e5c605beb8291386adae9bc1abe3d7357228295f2e532529ce57ce91501f WatchSource:0}: Error finding container 4df9e5c605beb8291386adae9bc1abe3d7357228295f2e532529ce57ce91501f: Status 404 returned error can't find the container with id 4df9e5c605beb8291386adae9bc1abe3d7357228295f2e532529ce57ce91501f
Jul 24 20:12:29.303536 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.303515    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"]
Jul 24 20:12:29.313559 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:12:29.313532    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfba8c4d_d3de_4573_a25a_392e048b54cc.slice/crio-1169c05f6ce56ef2716c8b176871f940a29c85cecf0270e0b013accda283e011 WatchSource:0}: Error finding container 1169c05f6ce56ef2716c8b176871f940a29c85cecf0270e0b013accda283e011: Status 404 returned error can't find the container with id 1169c05f6ce56ef2716c8b176871f940a29c85cecf0270e0b013accda283e011
Jul 24 20:12:29.739838 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.739804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8" event={"ID":"bfba8c4d-d3de-4573-a25a-392e048b54cc","Type":"ContainerStarted","Data":"8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1"}
Jul 24 20:12:29.740015 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.739864    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:29.740015 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.739890    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8" event={"ID":"bfba8c4d-d3de-4573-a25a-392e048b54cc","Type":"ContainerStarted","Data":"1169c05f6ce56ef2716c8b176871f940a29c85cecf0270e0b013accda283e011"}
Jul 24 20:12:29.741268 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.741243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh" event={"ID":"0977e831-ba32-4fd1-9818-15767dd68c3a","Type":"ContainerStarted","Data":"50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4"}
Jul 24 20:12:29.741365 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.741297    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:29.741365 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.741317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh" event={"ID":"0977e831-ba32-4fd1-9818-15767dd68c3a","Type":"ContainerStarted","Data":"4df9e5c605beb8291386adae9bc1abe3d7357228295f2e532529ce57ce91501f"}
Jul 24 20:12:29.756173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.756129    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8" podStartSLOduration=1.756114566 podStartE2EDuration="1.756114566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:12:29.754124127 +0000 UTC m=+2263.398387180" watchObservedRunningTime="2026-07-24 20:12:29.756114566 +0000 UTC m=+2263.400377584"
Jul 24 20:12:29.768980 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:29.768932    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh" podStartSLOduration=1.768912937 podStartE2EDuration="1.768912937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:12:29.768578933 +0000 UTC m=+2263.412841974" watchObservedRunningTime="2026-07-24 20:12:29.768912937 +0000 UTC m=+2263.413175978"
Jul 24 20:12:32.196824 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:32.196783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:38.919325 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:38.919293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:12:40.749022 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:40.748995    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:12:40.749416 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:40.749276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:12:55.680641 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:55.680606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:55.746064 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:55.746033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:55.799975 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:55.799942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:12:58.117248 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:12:58.117216    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:13:00.343208 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:00.343147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:00.708724 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:00.708692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:06.504529 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:06.504496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:06.604651 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:06.604619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:06.776976 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:06.776906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:07.029283 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:07.029206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:22.711441 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.711413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:22.728834 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.728803    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"]
Jul 24 20:13:22.729085 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.729036    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8" podUID="bfba8c4d-d3de-4573-a25a-392e048b54cc" containerName="payload-processing" containerID="cri-o://8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1" gracePeriod=30
Jul 24 20:13:22.736052 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.736025    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"]
Jul 24 20:13:22.736314 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.736260    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh" podUID="0977e831-ba32-4fd1-9818-15767dd68c3a" containerName="payload-pre-processing" containerID="cri-o://50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4" gracePeriod=30
Jul 24 20:13:22.996347 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.996328    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:13:22.999267 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:22.999242    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:13:23.009028 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.009005    2560 generic.go:356] "Generic (PLEG): container finished" podID="0977e831-ba32-4fd1-9818-15767dd68c3a" containerID="50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4" exitCode=0
Jul 24 20:13:23.009117 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.009039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"
Jul 24 20:13:23.009117 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.009082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh" event={"ID":"0977e831-ba32-4fd1-9818-15767dd68c3a","Type":"ContainerDied","Data":"50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4"}
Jul 24 20:13:23.009206 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.009140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh" event={"ID":"0977e831-ba32-4fd1-9818-15767dd68c3a","Type":"ContainerDied","Data":"4df9e5c605beb8291386adae9bc1abe3d7357228295f2e532529ce57ce91501f"}
Jul 24 20:13:23.009206 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.009169    2560 scope.go:117] "RemoveContainer" containerID="50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4"
Jul 24 20:13:23.010234 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.010215    2560 generic.go:356] "Generic (PLEG): container finished" podID="bfba8c4d-d3de-4573-a25a-392e048b54cc" containerID="8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1" exitCode=0
Jul 24 20:13:23.010303 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.010243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8" event={"ID":"bfba8c4d-d3de-4573-a25a-392e048b54cc","Type":"ContainerDied","Data":"8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1"}
Jul 24 20:13:23.010303 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.010292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8" event={"ID":"bfba8c4d-d3de-4573-a25a-392e048b54cc","Type":"ContainerDied","Data":"1169c05f6ce56ef2716c8b176871f940a29c85cecf0270e0b013accda283e011"}
Jul 24 20:13:23.010378 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.010249    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"
Jul 24 20:13:23.017504 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.017485    2560 scope.go:117] "RemoveContainer" containerID="50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4"
Jul 24 20:13:23.017852 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:13:23.017825    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4\": container with ID starting with 50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4 not found: ID does not exist" containerID="50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4"
Jul 24 20:13:23.017958 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.017861    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4"} err="failed to get container status \"50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4\": rpc error: code = NotFound desc = could not find container \"50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4\": container with ID starting with 50a5ba548a01f9b0e84786fa4a0d6d021a8c139c20d8ee2bcfe9ce425d2cb9b4 not found: ID does not exist"
Jul 24 20:13:23.017958 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.017885    2560 scope.go:117] "RemoveContainer" containerID="8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1"
Jul 24 20:13:23.030122 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.030105    2560 scope.go:117] "RemoveContainer" containerID="8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1"
Jul 24 20:13:23.030379 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:13:23.030363    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1\": container with ID starting with 8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1 not found: ID does not exist" containerID="8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1"
Jul 24 20:13:23.030441 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.030384    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1"} err="failed to get container status \"8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1\": rpc error: code = NotFound desc = could not find container \"8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1\": container with ID starting with 8f1ec790791e832fd1e7a32387c4b332d5f7d3ee2d407955d6ec23e4cfe3b3f1 not found: ID does not exist"
Jul 24 20:13:23.066516 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.066496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfba8c4d-d3de-4573-a25a-392e048b54cc-plugins-config-volume\") pod \"bfba8c4d-d3de-4573-a25a-392e048b54cc\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") "
Jul 24 20:13:23.066627 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.066531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slxpz\" (UniqueName: \"kubernetes.io/projected/bfba8c4d-d3de-4573-a25a-392e048b54cc-kube-api-access-slxpz\") pod \"bfba8c4d-d3de-4573-a25a-392e048b54cc\" (UID: \"bfba8c4d-d3de-4573-a25a-392e048b54cc\") "
Jul 24 20:13:23.066627 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.066580    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0977e831-ba32-4fd1-9818-15767dd68c3a-plugins-config-volume\") pod \"0977e831-ba32-4fd1-9818-15767dd68c3a\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") "
Jul 24 20:13:23.066734 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.066636    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnvl5\" (UniqueName: \"kubernetes.io/projected/0977e831-ba32-4fd1-9818-15767dd68c3a-kube-api-access-hnvl5\") pod \"0977e831-ba32-4fd1-9818-15767dd68c3a\" (UID: \"0977e831-ba32-4fd1-9818-15767dd68c3a\") "
Jul 24 20:13:23.066965 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.066940    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfba8c4d-d3de-4573-a25a-392e048b54cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bfba8c4d-d3de-4573-a25a-392e048b54cc" (UID: "bfba8c4d-d3de-4573-a25a-392e048b54cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:23.067023 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.066961    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0977e831-ba32-4fd1-9818-15767dd68c3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0977e831-ba32-4fd1-9818-15767dd68c3a" (UID: "0977e831-ba32-4fd1-9818-15767dd68c3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:13:23.068516 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.068489    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfba8c4d-d3de-4573-a25a-392e048b54cc-kube-api-access-slxpz" (OuterVolumeSpecName: "kube-api-access-slxpz") pod "bfba8c4d-d3de-4573-a25a-392e048b54cc" (UID: "bfba8c4d-d3de-4573-a25a-392e048b54cc"). InnerVolumeSpecName "kube-api-access-slxpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:23.068596 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.068554    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0977e831-ba32-4fd1-9818-15767dd68c3a-kube-api-access-hnvl5" (OuterVolumeSpecName: "kube-api-access-hnvl5") pod "0977e831-ba32-4fd1-9818-15767dd68c3a" (UID: "0977e831-ba32-4fd1-9818-15767dd68c3a"). InnerVolumeSpecName "kube-api-access-hnvl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:13:23.167876 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.167857    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfba8c4d-d3de-4573-a25a-392e048b54cc-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:13:23.167876 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.167877    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slxpz\" (UniqueName: \"kubernetes.io/projected/bfba8c4d-d3de-4573-a25a-392e048b54cc-kube-api-access-slxpz\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:13:23.167995 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.167887    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0977e831-ba32-4fd1-9818-15767dd68c3a-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:13:23.167995 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.167896    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnvl5\" (UniqueName: \"kubernetes.io/projected/0977e831-ba32-4fd1-9818-15767dd68c3a-kube-api-access-hnvl5\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:13:23.333795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.333773    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"]
Jul 24 20:13:23.337569 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.337549    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-247467-76fc6df478-42kj8"]
Jul 24 20:13:23.348260 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.348238    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"]
Jul 24 20:13:23.359500 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.354749    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-247467-9b87fdd48-826qh"]
Jul 24 20:13:23.970649 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:23.970619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:24.844209 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:24.844154    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0977e831-ba32-4fd1-9818-15767dd68c3a" path="/var/lib/kubelet/pods/0977e831-ba32-4fd1-9818-15767dd68c3a/volumes"
Jul 24 20:13:24.844668 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:24.844640    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfba8c4d-d3de-4573-a25a-392e048b54cc" path="/var/lib/kubelet/pods/bfba8c4d-d3de-4573-a25a-392e048b54cc/volumes"
Jul 24 20:13:27.226160 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:27.226120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:27.609662 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:27.609588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:27.617347 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:27.617325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:13:33.502041 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:33.502009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:33.560113 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:33.560076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:33.757400 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:33.757324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:33.970159 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:33.970129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:34.314151 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:34.314119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:34.646998 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:34.646933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:35.221683 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:35.221646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:37.183565 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:37.183515    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:37.272593 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:37.272563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:37.344804 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:37.344774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:37.863677 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:37.863635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:37.963131 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:37.963097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:38.093282 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:38.093253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:41.682013 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:41.681934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:41.999995 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:41.999921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:42.299684 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:42.299612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:42.611650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:42.611569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:13:42.770669 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:42.770639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:43.068647 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:43.068594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:45.166915 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:45.166867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:45.263084 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:45.263044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:45.441277 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:45.441200    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:45.576755 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:45.576731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:45.933345 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:45.933314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:46.039445 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.039351    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:46.041492 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.041416    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"]
Jul 24 20:13:46.042299 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.042273    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfba8c4d-d3de-4573-a25a-392e048b54cc" containerName="payload-processing"
Jul 24 20:13:46.042362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.042303    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfba8c4d-d3de-4573-a25a-392e048b54cc" containerName="payload-processing"
Jul 24 20:13:46.042362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.042325    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0977e831-ba32-4fd1-9818-15767dd68c3a" containerName="payload-pre-processing"
Jul 24 20:13:46.042362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.042332    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0977e831-ba32-4fd1-9818-15767dd68c3a" containerName="payload-pre-processing"
Jul 24 20:13:46.042503 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.042427    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfba8c4d-d3de-4573-a25a-392e048b54cc" containerName="payload-processing"
Jul 24 20:13:46.042503 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.042443    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0977e831-ba32-4fd1-9818-15767dd68c3a" containerName="payload-pre-processing"
Jul 24 20:13:46.048955 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.048901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.052934 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.052874    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-3f5fc9-dockercfg-962hd\""
Jul 24 20:13:46.052934 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.052909    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-3f5fc9\""
Jul 24 20:13:46.054538 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.054506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"]
Jul 24 20:13:46.063475 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.063429    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"]
Jul 24 20:13:46.067194 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.067172    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.076541 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.076518    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"]
Jul 24 20:13:46.169474 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.169369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fe0321-695e-44f6-b88a-8761174c1509-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.170244 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.169580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c892\" (UniqueName: \"kubernetes.io/projected/e9fe0321-695e-44f6-b88a-8761174c1509-kube-api-access-5c892\") pod \"payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.170244 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.169631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf620a1b-b10e-4155-9728-42cff8c8a3d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.170244 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.169749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5wbx\" (UniqueName: \"kubernetes.io/projected/cf620a1b-b10e-4155-9728-42cff8c8a3d0-kube-api-access-p5wbx\") pod \"payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.271785 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.271568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fe0321-695e-44f6-b88a-8761174c1509-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.271785 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.271688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c892\" (UniqueName: \"kubernetes.io/projected/e9fe0321-695e-44f6-b88a-8761174c1509-kube-api-access-5c892\") pod \"payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.271785 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.271716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf620a1b-b10e-4155-9728-42cff8c8a3d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.272351 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.271818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5wbx\" (UniqueName: \"kubernetes.io/projected/cf620a1b-b10e-4155-9728-42cff8c8a3d0-kube-api-access-p5wbx\") pod \"payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.272978 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.272947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf620a1b-b10e-4155-9728-42cff8c8a3d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.273035 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.272989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fe0321-695e-44f6-b88a-8761174c1509-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.283682 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.283616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5wbx\" (UniqueName: \"kubernetes.io/projected/cf620a1b-b10e-4155-9728-42cff8c8a3d0-kube-api-access-p5wbx\") pod \"payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.287271 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.287217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c892\" (UniqueName: \"kubernetes.io/projected/e9fe0321-695e-44f6-b88a-8761174c1509-kube-api-access-5c892\") pod \"payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.365855 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.365759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:46.378054 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.377997    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:46.619049 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.618979    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"]
Jul 24 20:13:46.624531 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:13:46.624432    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf620a1b_b10e_4155_9728_42cff8c8a3d0.slice/crio-7b48f7eb587d45e4cf9030fafce100ef2f057aacef11fced84d72977832289cb WatchSource:0}: Error finding container 7b48f7eb587d45e4cf9030fafce100ef2f057aacef11fced84d72977832289cb: Status 404 returned error can't find the container with id 7b48f7eb587d45e4cf9030fafce100ef2f057aacef11fced84d72977832289cb
Jul 24 20:13:46.645851 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:46.645768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"]
Jul 24 20:13:46.650883 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:13:46.650809    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fe0321_695e_44f6_b88a_8761174c1509.slice/crio-29f79405f16cfdee0ca925513753e1267b483d19d89ba7a21377305383bb91f4 WatchSource:0}: Error finding container 29f79405f16cfdee0ca925513753e1267b483d19d89ba7a21377305383bb91f4: Status 404 returned error can't find the container with id 29f79405f16cfdee0ca925513753e1267b483d19d89ba7a21377305383bb91f4
Jul 24 20:13:47.129176 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.129130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc" event={"ID":"cf620a1b-b10e-4155-9728-42cff8c8a3d0","Type":"ContainerStarted","Data":"b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7"}
Jul 24 20:13:47.129367 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.129301    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:47.129367 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.129346    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc" event={"ID":"cf620a1b-b10e-4155-9728-42cff8c8a3d0","Type":"ContainerStarted","Data":"7b48f7eb587d45e4cf9030fafce100ef2f057aacef11fced84d72977832289cb"}
Jul 24 20:13:47.130688 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.130665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx" event={"ID":"e9fe0321-695e-44f6-b88a-8761174c1509","Type":"ContainerStarted","Data":"e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb"}
Jul 24 20:13:47.130812 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.130709    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:47.130812 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.130725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx" event={"ID":"e9fe0321-695e-44f6-b88a-8761174c1509","Type":"ContainerStarted","Data":"29f79405f16cfdee0ca925513753e1267b483d19d89ba7a21377305383bb91f4"}
Jul 24 20:13:47.145070 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.145025    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc" podStartSLOduration=1.145008217 podStartE2EDuration="1.145008217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:47.143848922 +0000 UTC m=+2340.788111963" watchObservedRunningTime="2026-07-24 20:13:47.145008217 +0000 UTC m=+2340.789271260"
Jul 24 20:13:47.159224 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:47.159175    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx" podStartSLOduration=1.159164665 podStartE2EDuration="1.159164665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:13:47.158108647 +0000 UTC m=+2340.802371688" watchObservedRunningTime="2026-07-24 20:13:47.159164665 +0000 UTC m=+2340.803427699"
Jul 24 20:13:49.632612 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:49.632576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:53.832018 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:53.831970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:53.893295 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:53.893268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:55.613447 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:55.613407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:13:58.137639 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:58.137599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:13:58.138108 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:58.137694    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:13:59.526472 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.526419    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"]
Jul 24 20:13:59.531127 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.531101    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.534025 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.534000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"]
Jul 24 20:13:59.534930 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.534794    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-53d0a0\"/\"openshift-service-ca.crt\""
Jul 24 20:13:59.534930 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.534807    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-53d0a0\"/\"auth-test-model-53d0a0-kserve-self-signed-certs\""
Jul 24 20:13:59.534930 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.534845    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-53d0a0\"/\"default-dockercfg-d9kcd\""
Jul 24 20:13:59.534930 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.534915    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-53d0a0\"/\"kube-root-ca.crt\""
Jul 24 20:13:59.557146 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.557123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:13:59.693773 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.693728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-dshm\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.693897 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.693779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nczf\" (UniqueName: \"kubernetes.io/projected/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-kube-api-access-9nczf\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.693897 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.693845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tmp-dir\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.693897 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.693886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-model-cache\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.694067 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.693929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tls-certs\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.694067 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.693981    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-home\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.794623 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.794558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-home\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.794756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.794645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-dshm\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.794756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.794674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nczf\" (UniqueName: \"kubernetes.io/projected/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-kube-api-access-9nczf\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.794756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.794714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tmp-dir\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.794756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.794745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-model-cache\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.794973 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.794789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tls-certs\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.795064 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.795043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-home\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.795275 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.795248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tmp-dir\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.795356 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.795288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-model-cache\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.796867 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.796847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-dshm\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.797152 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.797136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tls-certs\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.801774 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.801750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nczf\" (UniqueName: \"kubernetes.io/projected/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-kube-api-access-9nczf\") pod \"auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") " pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.842862 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.842843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:13:59.974876 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:13:59.974854    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"]
Jul 24 20:13:59.977215 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:13:59.977190    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a539600_2ff9_476a_9bdb_1a57f17ab1f3.slice/crio-14f17f454096c3f5ea92a65442faa8e7e52c9d082b0596f9a776414929d75e04 WatchSource:0}: Error finding container 14f17f454096c3f5ea92a65442faa8e7e52c9d082b0596f9a776414929d75e04: Status 404 returned error can't find the container with id 14f17f454096c3f5ea92a65442faa8e7e52c9d082b0596f9a776414929d75e04
Jul 24 20:14:00.200088 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:00.200051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44" event={"ID":"6a539600-2ff9-476a-9bdb-1a57f17ab1f3","Type":"ContainerStarted","Data":"cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78"}
Jul 24 20:14:00.200228 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:00.200101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44" event={"ID":"6a539600-2ff9-476a-9bdb-1a57f17ab1f3","Type":"ContainerStarted","Data":"14f17f454096c3f5ea92a65442faa8e7e52c9d082b0596f9a776414929d75e04"}
Jul 24 20:14:00.216022 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:00.215980    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44" podStartSLOduration=1.215963222 podStartE2EDuration="1.215963222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:14:00.214636489 +0000 UTC m=+2353.858899529" watchObservedRunningTime="2026-07-24 20:14:00.215963222 +0000 UTC m=+2353.860226262"
Jul 24 20:14:03.620424 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:03.620384    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:14:09.843596 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:09.843564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:14:09.843596 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:09.843603    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:14:09.855950 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:09.855925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:14:10.260452 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:10.260425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:14:13.604868 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.604831    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"]
Jul 24 20:14:13.608590 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.608569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.612278 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.612258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"kube-root-ca.crt\""
Jul 24 20:14:13.612278 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.612267    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"auth-test-model-3f5fc9-kserve-self-signed-certs\""
Jul 24 20:14:13.612443 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.612267    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"default-dockercfg-wfk25\""
Jul 24 20:14:13.612443 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.612327    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"openshift-service-ca.crt\""
Jul 24 20:14:13.618738 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.618718    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"]
Jul 24 20:14:13.626075 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.626055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:14:13.713162 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.713141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-home\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.713284 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.713184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-model-cache\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.713284 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.713217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-dshm\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.713406 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.713298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl728\" (UniqueName: \"kubernetes.io/projected/91f9a02b-7a0d-4998-986d-41f61d4c0205-kube-api-access-xl728\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.713406 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.713350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-tmp-dir\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.713532 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.713478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f9a02b-7a0d-4998-986d-41f61d4c0205-tls-certs\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.814763 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.814740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-home\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.814867 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.814782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-model-cache\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.814867 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.814804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-dshm\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.814867 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.814833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl728\" (UniqueName: \"kubernetes.io/projected/91f9a02b-7a0d-4998-986d-41f61d4c0205-kube-api-access-xl728\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.814867 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.814855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-tmp-dir\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.815078 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.814872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f9a02b-7a0d-4998-986d-41f61d4c0205-tls-certs\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.815157 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.815137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-home\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.815219 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.815179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-model-cache\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.815258 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.815247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-tmp-dir\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.817064 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.817045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-dshm\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.817298 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.817281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f9a02b-7a0d-4998-986d-41f61d4c0205-tls-certs\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.822659 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.822643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl728\" (UniqueName: \"kubernetes.io/projected/91f9a02b-7a0d-4998-986d-41f61d4c0205-kube-api-access-xl728\") pod \"auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") " pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:13.919080 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:13.919055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:14.071949 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:14.071924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"]
Jul 24 20:14:14.073827 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:14:14.073800    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91f9a02b_7a0d_4998_986d_41f61d4c0205.slice/crio-fcf5e4fbfafff1953a1df41381222b00395369847fac57807f9e39d58fb2ab94 WatchSource:0}: Error finding container fcf5e4fbfafff1953a1df41381222b00395369847fac57807f9e39d58fb2ab94: Status 404 returned error can't find the container with id fcf5e4fbfafff1953a1df41381222b00395369847fac57807f9e39d58fb2ab94
Jul 24 20:14:14.271114 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:14.271032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q" event={"ID":"91f9a02b-7a0d-4998-986d-41f61d4c0205","Type":"ContainerStarted","Data":"78a0ac429680c4a2e628d9d115772e23e6257e33e1f99660827c9ca484829899"}
Jul 24 20:14:14.271114 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:14.271071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q" event={"ID":"91f9a02b-7a0d-4998-986d-41f61d4c0205","Type":"ContainerStarted","Data":"fcf5e4fbfafff1953a1df41381222b00395369847fac57807f9e39d58fb2ab94"}
Jul 24 20:14:14.287975 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:14.287927    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q" podStartSLOduration=1.287913747 podStartE2EDuration="1.287913747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:14:14.285785932 +0000 UTC m=+2367.930048966" watchObservedRunningTime="2026-07-24 20:14:14.287913747 +0000 UTC m=+2367.932176786"
Jul 24 20:14:17.808410 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:17.808376    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:14:22.940840 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:22.940810    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:14:23.041448 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:23.041419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:14:23.919619 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:23.919584    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:23.919619 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:23.919629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:23.931700 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:23.931676    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:24.340093 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:24.340020    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:14:31.714526 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:31.714490    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:14:46.105308 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:46.105276    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:14:46.935184 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:46.935150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:14:56.879441 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:14:56.879410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:15:04.011542 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:15:04.011514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:15:23.711267 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:15:23.711235    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:15:43.107503 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:15:43.107470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:16:01.211432 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:01.211395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:16:12.910699 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:12.910666    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"]
Jul 24 20:16:12.928445 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:12.928420    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:16:13.825219 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:13.825187    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"]
Jul 24 20:16:13.846685 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:13.846662    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:16:18.112711 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:18.112678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:16:27.618555 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.618522    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"]
Jul 24 20:16:27.621995 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.621979    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.624486 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.624446    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-53d0a0\"/\"sub-test-model-53d0a0-kserve-self-signed-certs\""
Jul 24 20:16:27.630189 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.630163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"]
Jul 24 20:16:27.642303 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.642283    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:16:27.773325 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.773301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-model-cache\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.773475 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.773337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tmp-dir\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.773475 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.773400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw8vb\" (UniqueName: \"kubernetes.io/projected/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-kube-api-access-pw8vb\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.773475 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.773427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-home\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.773650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.773498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-dshm\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.773650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.773540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tls-certs\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.874826 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.874758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-model-cache\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.874826 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.874791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tmp-dir\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.874991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.874827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw8vb\" (UniqueName: \"kubernetes.io/projected/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-kube-api-access-pw8vb\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.874991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.874854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-home\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.874991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.874904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-dshm\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.874991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.874930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tls-certs\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.875229 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.875208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-model-cache\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.875289 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.875271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-home\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.875348 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.875291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tmp-dir\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.877283 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.877262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-dshm\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.877471 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.877439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tls-certs\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.882668 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.882645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw8vb\" (UniqueName: \"kubernetes.io/projected/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-kube-api-access-pw8vb\") pod \"sub-test-model-53d0a0-kserve-68c786b8df-7jkhf\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") " pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:27.929944 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.929915    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44" podUID="6a539600-2ff9-476a-9bdb-1a57f17ab1f3" containerName="main" containerID="cri-o://cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78" gracePeriod=45
Jul 24 20:16:27.932436 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:27.932408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:28.065047 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.065019    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"]
Jul 24 20:16:28.066897 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:16:28.066870    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4edf6c21_538c_4e08_9d3e_ea43b1b503c1.slice/crio-4f86bcf33490dd6e7aef03e357717282e9d25a1598d249cc72cf04f4b795a813 WatchSource:0}: Error finding container 4f86bcf33490dd6e7aef03e357717282e9d25a1598d249cc72cf04f4b795a813: Status 404 returned error can't find the container with id 4f86bcf33490dd6e7aef03e357717282e9d25a1598d249cc72cf04f4b795a813
Jul 24 20:16:28.169395 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.169369    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:16:28.279512 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tls-certs\") pod \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") "
Jul 24 20:16:28.279638 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nczf\" (UniqueName: \"kubernetes.io/projected/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-kube-api-access-9nczf\") pod \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") "
Jul 24 20:16:28.279638 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279544    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-model-cache\") pod \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") "
Jul 24 20:16:28.279638 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279569    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-home\") pod \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") "
Jul 24 20:16:28.279786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279637    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-dshm\") pod \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") "
Jul 24 20:16:28.279786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279690    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tmp-dir\") pod \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\" (UID: \"6a539600-2ff9-476a-9bdb-1a57f17ab1f3\") "
Jul 24 20:16:28.279904 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-home" (OuterVolumeSpecName: "home") pod "6a539600-2ff9-476a-9bdb-1a57f17ab1f3" (UID: "6a539600-2ff9-476a-9bdb-1a57f17ab1f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:28.279904 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279841    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a539600-2ff9-476a-9bdb-1a57f17ab1f3" (UID: "6a539600-2ff9-476a-9bdb-1a57f17ab1f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:28.280014 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.279972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a539600-2ff9-476a-9bdb-1a57f17ab1f3" (UID: "6a539600-2ff9-476a-9bdb-1a57f17ab1f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:28.280119 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.280099    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:28.280119 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.280119    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:28.280275 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.280133    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:28.281735 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.281717    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-kube-api-access-9nczf" (OuterVolumeSpecName: "kube-api-access-9nczf") pod "6a539600-2ff9-476a-9bdb-1a57f17ab1f3" (UID: "6a539600-2ff9-476a-9bdb-1a57f17ab1f3"). InnerVolumeSpecName "kube-api-access-9nczf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:16:28.281795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.281729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-dshm" (OuterVolumeSpecName: "dshm") pod "6a539600-2ff9-476a-9bdb-1a57f17ab1f3" (UID: "6a539600-2ff9-476a-9bdb-1a57f17ab1f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:28.281795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.281752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a539600-2ff9-476a-9bdb-1a57f17ab1f3" (UID: "6a539600-2ff9-476a-9bdb-1a57f17ab1f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:16:28.380902 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.380878    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:28.380902 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.380900    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:28.381049 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.380916    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nczf\" (UniqueName: \"kubernetes.io/projected/6a539600-2ff9-476a-9bdb-1a57f17ab1f3-kube-api-access-9nczf\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:28.844521 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.844478    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q" podUID="91f9a02b-7a0d-4998-986d-41f61d4c0205" containerName="main" containerID="cri-o://78a0ac429680c4a2e628d9d115772e23e6257e33e1f99660827c9ca484829899" gracePeriod=45
Jul 24 20:16:28.964002 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.963977    2560 generic.go:356] "Generic (PLEG): container finished" podID="91f9a02b-7a0d-4998-986d-41f61d4c0205" containerID="78a0ac429680c4a2e628d9d115772e23e6257e33e1f99660827c9ca484829899" exitCode=0
Jul 24 20:16:28.964128 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.964052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q" event={"ID":"91f9a02b-7a0d-4998-986d-41f61d4c0205","Type":"ContainerDied","Data":"78a0ac429680c4a2e628d9d115772e23e6257e33e1f99660827c9ca484829899"}
Jul 24 20:16:28.965662 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.965640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf" event={"ID":"4edf6c21-538c-4e08-9d3e-ea43b1b503c1","Type":"ContainerStarted","Data":"c52bcbe163e348bb82660439623ebfcaa4a3fbe302d5d9b7c17f06e092ad58f4"}
Jul 24 20:16:28.965770 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.965673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf" event={"ID":"4edf6c21-538c-4e08-9d3e-ea43b1b503c1","Type":"ContainerStarted","Data":"4f86bcf33490dd6e7aef03e357717282e9d25a1598d249cc72cf04f4b795a813"}
Jul 24 20:16:28.966952 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.966933    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a539600-2ff9-476a-9bdb-1a57f17ab1f3" containerID="cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78" exitCode=0
Jul 24 20:16:28.967034 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.966964    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"
Jul 24 20:16:28.967034 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.966989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44" event={"ID":"6a539600-2ff9-476a-9bdb-1a57f17ab1f3","Type":"ContainerDied","Data":"cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78"}
Jul 24 20:16:28.967034 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.967012    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44" event={"ID":"6a539600-2ff9-476a-9bdb-1a57f17ab1f3","Type":"ContainerDied","Data":"14f17f454096c3f5ea92a65442faa8e7e52c9d082b0596f9a776414929d75e04"}
Jul 24 20:16:28.967034 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.967027    2560 scope.go:117] "RemoveContainer" containerID="cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78"
Jul 24 20:16:28.976054 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.976038    2560 scope.go:117] "RemoveContainer" containerID="cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78"
Jul 24 20:16:28.976303 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:16:28.976284    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78\": container with ID starting with cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78 not found: ID does not exist" containerID="cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78"
Jul 24 20:16:28.976362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.976313    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78"} err="failed to get container status \"cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78\": rpc error: code = NotFound desc = could not find container \"cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78\": container with ID starting with cf3ccccf239ed11148efe1dcd376b9113f93bfc5a0a9437e04346e81748d5b78 not found: ID does not exist"
Jul 24 20:16:28.981791 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.981749    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf" podStartSLOduration=1.9817371879999999 podStartE2EDuration="1.981737188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:28.980815442 +0000 UTC m=+2502.625078483" watchObservedRunningTime="2026-07-24 20:16:28.981737188 +0000 UTC m=+2502.626000228"
Jul 24 20:16:28.995005 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.994984    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"]
Jul 24 20:16:28.998647 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:28.998608    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/auth-test-model-53d0a0-kserve-5f68d49dcf-zsw44"]
Jul 24 20:16:29.103786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.103736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:16:29.188621 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188600    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f9a02b-7a0d-4998-986d-41f61d4c0205-tls-certs\") pod \"91f9a02b-7a0d-4998-986d-41f61d4c0205\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") "
Jul 24 20:16:29.188740 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-model-cache\") pod \"91f9a02b-7a0d-4998-986d-41f61d4c0205\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") "
Jul 24 20:16:29.188740 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-tmp-dir\") pod \"91f9a02b-7a0d-4998-986d-41f61d4c0205\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") "
Jul 24 20:16:29.188740 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-home\") pod \"91f9a02b-7a0d-4998-986d-41f61d4c0205\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") "
Jul 24 20:16:29.188863 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188779    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl728\" (UniqueName: \"kubernetes.io/projected/91f9a02b-7a0d-4998-986d-41f61d4c0205-kube-api-access-xl728\") pod \"91f9a02b-7a0d-4998-986d-41f61d4c0205\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") "
Jul 24 20:16:29.188863 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188825    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-dshm\") pod \"91f9a02b-7a0d-4998-986d-41f61d4c0205\" (UID: \"91f9a02b-7a0d-4998-986d-41f61d4c0205\") "
Jul 24 20:16:29.188966 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188897    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-model-cache" (OuterVolumeSpecName: "model-cache") pod "91f9a02b-7a0d-4998-986d-41f61d4c0205" (UID: "91f9a02b-7a0d-4998-986d-41f61d4c0205"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:29.189028 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.188948    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91f9a02b-7a0d-4998-986d-41f61d4c0205" (UID: "91f9a02b-7a0d-4998-986d-41f61d4c0205"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:29.189028 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.189012    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-home" (OuterVolumeSpecName: "home") pod "91f9a02b-7a0d-4998-986d-41f61d4c0205" (UID: "91f9a02b-7a0d-4998-986d-41f61d4c0205"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:29.189137 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.189113    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:29.189137 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.189125    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:29.189137 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.189133    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:29.190836 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.190815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f9a02b-7a0d-4998-986d-41f61d4c0205-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91f9a02b-7a0d-4998-986d-41f61d4c0205" (UID: "91f9a02b-7a0d-4998-986d-41f61d4c0205"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:16:29.191373 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.191355    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-dshm" (OuterVolumeSpecName: "dshm") pod "91f9a02b-7a0d-4998-986d-41f61d4c0205" (UID: "91f9a02b-7a0d-4998-986d-41f61d4c0205"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:16:29.191441 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.191397    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f9a02b-7a0d-4998-986d-41f61d4c0205-kube-api-access-xl728" (OuterVolumeSpecName: "kube-api-access-xl728") pod "91f9a02b-7a0d-4998-986d-41f61d4c0205" (UID: "91f9a02b-7a0d-4998-986d-41f61d4c0205"). InnerVolumeSpecName "kube-api-access-xl728". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:16:29.289680 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.289658    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl728\" (UniqueName: \"kubernetes.io/projected/91f9a02b-7a0d-4998-986d-41f61d4c0205-kube-api-access-xl728\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:29.289680 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.289677    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f9a02b-7a0d-4998-986d-41f61d4c0205-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:29.289810 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.289686    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f9a02b-7a0d-4998-986d-41f61d4c0205-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:16:29.974643 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.974605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q" event={"ID":"91f9a02b-7a0d-4998-986d-41f61d4c0205","Type":"ContainerDied","Data":"fcf5e4fbfafff1953a1df41381222b00395369847fac57807f9e39d58fb2ab94"}
Jul 24 20:16:29.974643 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.974628    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"
Jul 24 20:16:29.975187 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.974659    2560 scope.go:117] "RemoveContainer" containerID="78a0ac429680c4a2e628d9d115772e23e6257e33e1f99660827c9ca484829899"
Jul 24 20:16:29.999799 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:29.999772    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"]
Jul 24 20:16:30.003330 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:30.003309    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/auth-test-model-3f5fc9-kserve-764d64b7bc-w9m7q"]
Jul 24 20:16:30.843437 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:30.843406    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a539600-2ff9-476a-9bdb-1a57f17ab1f3" path="/var/lib/kubelet/pods/6a539600-2ff9-476a-9bdb-1a57f17ab1f3/volumes"
Jul 24 20:16:30.843815 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:30.843800    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f9a02b-7a0d-4998-986d-41f61d4c0205" path="/var/lib/kubelet/pods/91f9a02b-7a0d-4998-986d-41f61d4c0205/volumes"
Jul 24 20:16:31.718890 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:31.718854    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:16:37.932991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:37.932947    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:37.933428 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:37.933004    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:37.945786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:37.945759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:16:38.025121 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:16:38.025099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:17:07.906910 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.906874    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"]
Jul 24 20:17:07.907508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.907383    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f9a02b-7a0d-4998-986d-41f61d4c0205" containerName="main"
Jul 24 20:17:07.907508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.907400    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f9a02b-7a0d-4998-986d-41f61d4c0205" containerName="main"
Jul 24 20:17:07.907508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.907413    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a539600-2ff9-476a-9bdb-1a57f17ab1f3" containerName="main"
Jul 24 20:17:07.907508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.907440    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a539600-2ff9-476a-9bdb-1a57f17ab1f3" containerName="main"
Jul 24 20:17:07.907749 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.907586    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a539600-2ff9-476a-9bdb-1a57f17ab1f3" containerName="main"
Jul 24 20:17:07.907749 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.907604    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f9a02b-7a0d-4998-986d-41f61d4c0205" containerName="main"
Jul 24 20:17:07.910650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.910631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:07.913019 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.912998    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"sub-test-model-3f5fc9-kserve-self-signed-certs\""
Jul 24 20:17:07.914216 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.914196    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"default-dockercfg-wfk25\""
Jul 24 20:17:07.914322 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.914233    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"openshift-service-ca.crt\""
Jul 24 20:17:07.914322 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.914253    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"kube-root-ca.crt\""
Jul 24 20:17:07.920722 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.920702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"]
Jul 24 20:17:07.928111 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:07.928093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:17:08.006468 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.006441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-home\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.006561 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.006499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f943826e-f0aa-4156-a6f4-253580b4ba14-tls-certs\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.006611 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.006573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-dshm\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.006649 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.006609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-tmp-dir\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.006649 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.006638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-model-cache\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.006731 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.006659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdg8\" (UniqueName: \"kubernetes.io/projected/f943826e-f0aa-4156-a6f4-253580b4ba14-kube-api-access-rvdg8\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107543 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-home\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107638 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f943826e-f0aa-4156-a6f4-253580b4ba14-tls-certs\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107697 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-dshm\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107746 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-tmp-dir\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107792 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-model-cache\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107836 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdg8\" (UniqueName: \"kubernetes.io/projected/f943826e-f0aa-4156-a6f4-253580b4ba14-kube-api-access-rvdg8\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.107931 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.107911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-home\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.108065 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.108039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-tmp-dir\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.108159 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.108067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-model-cache\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.109776 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.109762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-dshm\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.110128 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.110112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f943826e-f0aa-4156-a6f4-253580b4ba14-tls-certs\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.115521 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.115501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdg8\" (UniqueName: \"kubernetes.io/projected/f943826e-f0aa-4156-a6f4-253580b4ba14-kube-api-access-rvdg8\") pod \"sub-test-model-3f5fc9-kserve-57999976f9-tsp42\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") " pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.220359 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.220333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:08.350109 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:08.350083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"]
Jul 24 20:17:08.352467 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:17:08.352436    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf943826e_f0aa_4156_a6f4_253580b4ba14.slice/crio-d86944e95f02a1cf0b3235674e8c19121fac4efd984192b430a35b7332c05621 WatchSource:0}: Error finding container d86944e95f02a1cf0b3235674e8c19121fac4efd984192b430a35b7332c05621: Status 404 returned error can't find the container with id d86944e95f02a1cf0b3235674e8c19121fac4efd984192b430a35b7332c05621
Jul 24 20:17:09.178061 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:09.178027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42" event={"ID":"f943826e-f0aa-4156-a6f4-253580b4ba14","Type":"ContainerStarted","Data":"75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963"}
Jul 24 20:17:09.178541 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:09.178069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42" event={"ID":"f943826e-f0aa-4156-a6f4-253580b4ba14","Type":"ContainerStarted","Data":"d86944e95f02a1cf0b3235674e8c19121fac4efd984192b430a35b7332c05621"}
Jul 24 20:17:09.195721 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:09.195676    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42" podStartSLOduration=2.195662976 podStartE2EDuration="2.195662976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:17:09.193168443 +0000 UTC m=+2542.837431483" watchObservedRunningTime="2026-07-24 20:17:09.195662976 +0000 UTC m=+2542.839926091"
Jul 24 20:17:11.409573 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:11.409471    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:17:18.220680 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:18.220649    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:18.221252 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:18.220692    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:18.233310 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:18.233284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:19.241842 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:19.241759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:17:26.017918 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:26.017876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:17:46.301884 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:46.301851    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"]
Jul 24 20:17:46.322583 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:46.322554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:17:47.788896 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:47.788863    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"]
Jul 24 20:17:47.808648 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:47.808620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:17:50.010664 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:50.010627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:17:54.416843 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:54.416809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:17:58.413811 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.413772    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"]
Jul 24 20:17:58.417305 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.417283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.419804 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.419783    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-53d0a0\"/\"rate-test-model-53d0a0-kserve-self-signed-certs\""
Jul 24 20:17:58.425420 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.425308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"]
Jul 24 20:17:58.444056 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.444033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:17:58.553108 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.553086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-model-cache\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.553217 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.553110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tmp-dir\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.553217 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.553141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-dshm\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.553310 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.553220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d5tp\" (UniqueName: \"kubernetes.io/projected/3660e9eb-0650-46bc-a18b-b54fbe329eb9-kube-api-access-6d5tp\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.553310 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.553239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tls-certs\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.553310 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.553253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-home\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654495 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d5tp\" (UniqueName: \"kubernetes.io/projected/3660e9eb-0650-46bc-a18b-b54fbe329eb9-kube-api-access-6d5tp\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654601 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tls-certs\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654601 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-home\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654715 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-model-cache\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654715 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tmp-dir\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654715 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-dshm\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.654991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-home\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.655063 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.654995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-model-cache\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.655063 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.655020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tmp-dir\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.656815 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.656788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-dshm\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.656963 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.656947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tls-certs\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.664062 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.664017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d5tp\" (UniqueName: \"kubernetes.io/projected/3660e9eb-0650-46bc-a18b-b54fbe329eb9-kube-api-access-6d5tp\") pod \"rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") " pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.728817 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.728801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:17:58.858412 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:58.858389    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"]
Jul 24 20:17:58.860517 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:17:58.860490    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3660e9eb_0650_46bc_a18b_b54fbe329eb9.slice/crio-8bcb089b45f20348ae196192d9068b321580a1c7ac962518149837554334b6d5 WatchSource:0}: Error finding container 8bcb089b45f20348ae196192d9068b321580a1c7ac962518149837554334b6d5: Status 404 returned error can't find the container with id 8bcb089b45f20348ae196192d9068b321580a1c7ac962518149837554334b6d5
Jul 24 20:17:59.442416 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:59.442382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh" event={"ID":"3660e9eb-0650-46bc-a18b-b54fbe329eb9","Type":"ContainerStarted","Data":"6579e27674fbebc95c23efb9c7562d57f99c4eb055efbcc5071c9ab4ea6f6e3a"}
Jul 24 20:17:59.442416 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:59.442423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh" event={"ID":"3660e9eb-0650-46bc-a18b-b54fbe329eb9","Type":"ContainerStarted","Data":"8bcb089b45f20348ae196192d9068b321580a1c7ac962518149837554334b6d5"}
Jul 24 20:17:59.460728 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:17:59.460682    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh" podStartSLOduration=1.460666045 podStartE2EDuration="1.460666045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:17:59.458330685 +0000 UTC m=+2593.102593725" watchObservedRunningTime="2026-07-24 20:17:59.460666045 +0000 UTC m=+2593.104929084"
Jul 24 20:18:01.321954 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.321890    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf" podUID="4edf6c21-538c-4e08-9d3e-ea43b1b503c1" containerName="main" containerID="cri-o://c52bcbe163e348bb82660439623ebfcaa4a3fbe302d5d9b7c17f06e092ad58f4" gracePeriod=45
Jul 24 20:18:01.456370 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.456337    2560 generic.go:356] "Generic (PLEG): container finished" podID="4edf6c21-538c-4e08-9d3e-ea43b1b503c1" containerID="c52bcbe163e348bb82660439623ebfcaa4a3fbe302d5d9b7c17f06e092ad58f4" exitCode=0
Jul 24 20:18:01.456513 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.456377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf" event={"ID":"4edf6c21-538c-4e08-9d3e-ea43b1b503c1","Type":"ContainerDied","Data":"c52bcbe163e348bb82660439623ebfcaa4a3fbe302d5d9b7c17f06e092ad58f4"}
Jul 24 20:18:01.574327 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.574275    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:18:01.680823 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.680795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tmp-dir\") pod \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") "
Jul 24 20:18:01.680962 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.680830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-dshm\") pod \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") "
Jul 24 20:18:01.680962 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.680888    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tls-certs\") pod \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") "
Jul 24 20:18:01.680962 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.680910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-model-cache\") pod \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") "
Jul 24 20:18:01.680962 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.680928    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-home\") pod \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") "
Jul 24 20:18:01.680962 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.680951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw8vb\" (UniqueName: \"kubernetes.io/projected/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-kube-api-access-pw8vb\") pod \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\" (UID: \"4edf6c21-538c-4e08-9d3e-ea43b1b503c1\") "
Jul 24 20:18:01.681232 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.681059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4edf6c21-538c-4e08-9d3e-ea43b1b503c1" (UID: "4edf6c21-538c-4e08-9d3e-ea43b1b503c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:01.681232 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.681176    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "4edf6c21-538c-4e08-9d3e-ea43b1b503c1" (UID: "4edf6c21-538c-4e08-9d3e-ea43b1b503c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:01.681232 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.681186    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-home" (OuterVolumeSpecName: "home") pod "4edf6c21-538c-4e08-9d3e-ea43b1b503c1" (UID: "4edf6c21-538c-4e08-9d3e-ea43b1b503c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:01.681353 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.681319    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:01.681353 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.681341    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:01.681423 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.681353    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:01.682968 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.682947    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-dshm" (OuterVolumeSpecName: "dshm") pod "4edf6c21-538c-4e08-9d3e-ea43b1b503c1" (UID: "4edf6c21-538c-4e08-9d3e-ea43b1b503c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:01.683063 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.683038    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-kube-api-access-pw8vb" (OuterVolumeSpecName: "kube-api-access-pw8vb") pod "4edf6c21-538c-4e08-9d3e-ea43b1b503c1" (UID: "4edf6c21-538c-4e08-9d3e-ea43b1b503c1"). InnerVolumeSpecName "kube-api-access-pw8vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:18:01.683162 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.683143    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4edf6c21-538c-4e08-9d3e-ea43b1b503c1" (UID: "4edf6c21-538c-4e08-9d3e-ea43b1b503c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:18:01.782736 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.782670    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:01.782736 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.782697    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:01.782736 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:01.782714    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw8vb\" (UniqueName: \"kubernetes.io/projected/4edf6c21-538c-4e08-9d3e-ea43b1b503c1-kube-api-access-pw8vb\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:02.462822 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.462792    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"
Jul 24 20:18:02.462822 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.462801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf" event={"ID":"4edf6c21-538c-4e08-9d3e-ea43b1b503c1","Type":"ContainerDied","Data":"4f86bcf33490dd6e7aef03e357717282e9d25a1598d249cc72cf04f4b795a813"}
Jul 24 20:18:02.463347 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.462845    2560 scope.go:117] "RemoveContainer" containerID="c52bcbe163e348bb82660439623ebfcaa4a3fbe302d5d9b7c17f06e092ad58f4"
Jul 24 20:18:02.485975 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.485948    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"]
Jul 24 20:18:02.490167 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.490145    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/sub-test-model-53d0a0-kserve-68c786b8df-7jkhf"]
Jul 24 20:18:02.808427 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.808345    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42" podUID="f943826e-f0aa-4156-a6f4-253580b4ba14" containerName="main" containerID="cri-o://75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963" gracePeriod=45
Jul 24 20:18:02.843622 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:02.843596    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4edf6c21-538c-4e08-9d3e-ea43b1b503c1" path="/var/lib/kubelet/pods/4edf6c21-538c-4e08-9d3e-ea43b1b503c1/volumes"
Jul 24 20:18:03.051685 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.051661    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:18:03.196795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.196771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-dshm\") pod \"f943826e-f0aa-4156-a6f4-253580b4ba14\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") "
Jul 24 20:18:03.196953 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.196822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f943826e-f0aa-4156-a6f4-253580b4ba14-tls-certs\") pod \"f943826e-f0aa-4156-a6f4-253580b4ba14\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") "
Jul 24 20:18:03.196953 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.196860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvdg8\" (UniqueName: \"kubernetes.io/projected/f943826e-f0aa-4156-a6f4-253580b4ba14-kube-api-access-rvdg8\") pod \"f943826e-f0aa-4156-a6f4-253580b4ba14\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") "
Jul 24 20:18:03.196953 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.196903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-tmp-dir\") pod \"f943826e-f0aa-4156-a6f4-253580b4ba14\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") "
Jul 24 20:18:03.196953 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.196953    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-home\") pod \"f943826e-f0aa-4156-a6f4-253580b4ba14\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") "
Jul 24 20:18:03.197165 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.196981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-model-cache\") pod \"f943826e-f0aa-4156-a6f4-253580b4ba14\" (UID: \"f943826e-f0aa-4156-a6f4-253580b4ba14\") "
Jul 24 20:18:03.197258 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.197219    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f943826e-f0aa-4156-a6f4-253580b4ba14" (UID: "f943826e-f0aa-4156-a6f4-253580b4ba14"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:03.197318 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.197274    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-home" (OuterVolumeSpecName: "home") pod "f943826e-f0aa-4156-a6f4-253580b4ba14" (UID: "f943826e-f0aa-4156-a6f4-253580b4ba14"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:03.197395 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.197377    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-model-cache" (OuterVolumeSpecName: "model-cache") pod "f943826e-f0aa-4156-a6f4-253580b4ba14" (UID: "f943826e-f0aa-4156-a6f4-253580b4ba14"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:03.198730 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.198712    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-dshm" (OuterVolumeSpecName: "dshm") pod "f943826e-f0aa-4156-a6f4-253580b4ba14" (UID: "f943826e-f0aa-4156-a6f4-253580b4ba14"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:18:03.198875 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.198854    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f943826e-f0aa-4156-a6f4-253580b4ba14-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f943826e-f0aa-4156-a6f4-253580b4ba14" (UID: "f943826e-f0aa-4156-a6f4-253580b4ba14"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:18:03.198920 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.198876    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f943826e-f0aa-4156-a6f4-253580b4ba14-kube-api-access-rvdg8" (OuterVolumeSpecName: "kube-api-access-rvdg8") pod "f943826e-f0aa-4156-a6f4-253580b4ba14" (UID: "f943826e-f0aa-4156-a6f4-253580b4ba14"). InnerVolumeSpecName "kube-api-access-rvdg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:18:03.298572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.298543    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:03.298572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.298566    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f943826e-f0aa-4156-a6f4-253580b4ba14-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:03.298572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.298578    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvdg8\" (UniqueName: \"kubernetes.io/projected/f943826e-f0aa-4156-a6f4-253580b4ba14-kube-api-access-rvdg8\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:03.298797 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.298586    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:03.298797 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.298594    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:03.298797 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.298601    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f943826e-f0aa-4156-a6f4-253580b4ba14-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:18:03.469166 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.469094    2560 generic.go:356] "Generic (PLEG): container finished" podID="f943826e-f0aa-4156-a6f4-253580b4ba14" containerID="75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963" exitCode=0
Jul 24 20:18:03.469166 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.469139    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"
Jul 24 20:18:03.469684 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.469192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42" event={"ID":"f943826e-f0aa-4156-a6f4-253580b4ba14","Type":"ContainerDied","Data":"75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963"}
Jul 24 20:18:03.469684 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.469240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42" event={"ID":"f943826e-f0aa-4156-a6f4-253580b4ba14","Type":"ContainerDied","Data":"d86944e95f02a1cf0b3235674e8c19121fac4efd984192b430a35b7332c05621"}
Jul 24 20:18:03.469684 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.469267    2560 scope.go:117] "RemoveContainer" containerID="75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963"
Jul 24 20:18:03.478291 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.478275    2560 scope.go:117] "RemoveContainer" containerID="75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963"
Jul 24 20:18:03.478577 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:18:03.478557    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963\": container with ID starting with 75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963 not found: ID does not exist" containerID="75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963"
Jul 24 20:18:03.478634 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.478586    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963"} err="failed to get container status \"75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963\": rpc error: code = NotFound desc = could not find container \"75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963\": container with ID starting with 75906556ec8be00857bea8c6cc84d4ae1b3bdba2eefc9910bdf3e315e72ec963 not found: ID does not exist"
Jul 24 20:18:03.490866 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.490846    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"]
Jul 24 20:18:03.494549 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.494531    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/sub-test-model-3f5fc9-kserve-57999976f9-tsp42"]
Jul 24 20:18:03.620232 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:03.620207    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:18:04.842842 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:04.842804    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f943826e-f0aa-4156-a6f4-253580b4ba14" path="/var/lib/kubelet/pods/f943826e-f0aa-4156-a6f4-253580b4ba14/volumes"
Jul 24 20:18:08.729600 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:08.729513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:18:08.729600 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:08.729574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:18:08.741768 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:08.741745    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:18:09.520212 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:09.520185    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:18:18.314299 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.314261    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"]
Jul 24 20:18:18.314883 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.314859    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f943826e-f0aa-4156-a6f4-253580b4ba14" containerName="main"
Jul 24 20:18:18.314883 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.314877    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f943826e-f0aa-4156-a6f4-253580b4ba14" containerName="main"
Jul 24 20:18:18.315011 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.314909    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4edf6c21-538c-4e08-9d3e-ea43b1b503c1" containerName="main"
Jul 24 20:18:18.315011 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.314919    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4edf6c21-538c-4e08-9d3e-ea43b1b503c1" containerName="main"
Jul 24 20:18:18.315112 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.315043    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f943826e-f0aa-4156-a6f4-253580b4ba14" containerName="main"
Jul 24 20:18:18.315112 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.315062    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4edf6c21-538c-4e08-9d3e-ea43b1b503c1" containerName="main"
Jul 24 20:18:18.319906 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.319887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.323786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.323432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"default-dockercfg-wfk25\""
Jul 24 20:18:18.323786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.323442    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"kube-root-ca.crt\""
Jul 24 20:18:18.323786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.323577    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"rate-test-model-3f5fc9-kserve-self-signed-certs\""
Jul 24 20:18:18.323786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.323494    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3f5fc9\"/\"openshift-service-ca.crt\""
Jul 24 20:18:18.325670 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.325645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b778e0-acaf-419b-8708-08bf697a73e5-tls-certs\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.325809 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.325721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-tmp-dir\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.325809 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.325789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-dshm\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.325925 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.325815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrwkh\" (UniqueName: \"kubernetes.io/projected/40b778e0-acaf-419b-8708-08bf697a73e5-kube-api-access-qrwkh\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.325925 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.325908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-model-cache\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.326035 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.325988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-home\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.326265 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.326242    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"]
Jul 24 20:18:18.340340 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.340319    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:18:18.426972 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.426952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-dshm\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427089 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.426979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrwkh\" (UniqueName: \"kubernetes.io/projected/40b778e0-acaf-419b-8708-08bf697a73e5-kube-api-access-qrwkh\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427089 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-model-cache\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427089 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-home\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427240 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b778e0-acaf-419b-8708-08bf697a73e5-tls-certs\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427240 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-tmp-dir\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427414 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-model-cache\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427502 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-home\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.427556 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.427508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-tmp-dir\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.429258 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.429238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-dshm\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.429540 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.429525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b778e0-acaf-419b-8708-08bf697a73e5-tls-certs\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.434384 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.434363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrwkh\" (UniqueName: \"kubernetes.io/projected/40b778e0-acaf-419b-8708-08bf697a73e5-kube-api-access-qrwkh\") pod \"rate-test-model-3f5fc9-kserve-9544df867-zwnhh\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") " pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.630377 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.630325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:18.763990 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:18.763819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"]
Jul 24 20:18:18.766602 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:18:18.766572    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40b778e0_acaf_419b_8708_08bf697a73e5.slice/crio-1e4fb32a0212e64a717d8fab645b8b031e4ad5ded9473b0a63170da1dd23197b WatchSource:0}: Error finding container 1e4fb32a0212e64a717d8fab645b8b031e4ad5ded9473b0a63170da1dd23197b: Status 404 returned error can't find the container with id 1e4fb32a0212e64a717d8fab645b8b031e4ad5ded9473b0a63170da1dd23197b
Jul 24 20:18:19.563393 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:19.563356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh" event={"ID":"40b778e0-acaf-419b-8708-08bf697a73e5","Type":"ContainerStarted","Data":"61cfb8ddff5873cc00fce665124a6f706b2b19d669bd40f54514af8bbd8cd15a"}
Jul 24 20:18:19.563393 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:19.563399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh" event={"ID":"40b778e0-acaf-419b-8708-08bf697a73e5","Type":"ContainerStarted","Data":"1e4fb32a0212e64a717d8fab645b8b031e4ad5ded9473b0a63170da1dd23197b"}
Jul 24 20:18:19.581360 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:19.581313    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh" podStartSLOduration=1.581298249 podStartE2EDuration="1.581298249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:18:19.579103739 +0000 UTC m=+2613.223366800" watchObservedRunningTime="2026-07-24 20:18:19.581298249 +0000 UTC m=+2613.225561288"
Jul 24 20:18:22.207426 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:22.207391    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:18:28.630927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:28.630890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:28.631356 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:28.630945    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:28.643737 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:28.643707    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:29.625767 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:29.625737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:18:44.341245 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:44.341212    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:18:47.077390 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:47.077311    2560 scope.go:117] "RemoveContainer" containerID="f1a66b1343ffc839262af4776fbf8b1fafd03d61c23d78198993856bd45f62ad"
Jul 24 20:18:58.915563 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:18:58.915526    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:19:04.245922 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:04.245869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:05.456858 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:05.456822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:06.613241 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:06.613211    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"]
Jul 24 20:19:06.631511 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:06.631483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:07.656173 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:07.656138    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"]
Jul 24 20:19:07.687979 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:07.687950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:14.211703 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:14.211671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:19:21.633748 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:21.633643    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh" podUID="3660e9eb-0650-46bc-a18b-b54fbe329eb9" containerName="main" containerID="cri-o://6579e27674fbebc95c23efb9c7562d57f99c4eb055efbcc5071c9ab4ea6f6e3a" gracePeriod=45
Jul 24 20:19:21.888091 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:21.887893    2560 generic.go:356] "Generic (PLEG): container finished" podID="3660e9eb-0650-46bc-a18b-b54fbe329eb9" containerID="6579e27674fbebc95c23efb9c7562d57f99c4eb055efbcc5071c9ab4ea6f6e3a" exitCode=0
Jul 24 20:19:21.888091 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:21.887962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh" event={"ID":"3660e9eb-0650-46bc-a18b-b54fbe329eb9","Type":"ContainerDied","Data":"6579e27674fbebc95c23efb9c7562d57f99c4eb055efbcc5071c9ab4ea6f6e3a"}
Jul 24 20:19:21.954246 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:21.954219    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:19:22.089277 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-model-cache\") pod \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") "
Jul 24 20:19:22.089487 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089324    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-home\") pod \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") "
Jul 24 20:19:22.089487 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tmp-dir\") pod \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") "
Jul 24 20:19:22.089487 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089380    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d5tp\" (UniqueName: \"kubernetes.io/projected/3660e9eb-0650-46bc-a18b-b54fbe329eb9-kube-api-access-6d5tp\") pod \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") "
Jul 24 20:19:22.089487 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089409    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-dshm\") pod \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") "
Jul 24 20:19:22.089487 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089428    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tls-certs\") pod \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\" (UID: \"3660e9eb-0650-46bc-a18b-b54fbe329eb9\") "
Jul 24 20:19:22.089768 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089576    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "3660e9eb-0650-46bc-a18b-b54fbe329eb9" (UID: "3660e9eb-0650-46bc-a18b-b54fbe329eb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.089768 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089664    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-home" (OuterVolumeSpecName: "home") pod "3660e9eb-0650-46bc-a18b-b54fbe329eb9" (UID: "3660e9eb-0650-46bc-a18b-b54fbe329eb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.089768 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089676    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3660e9eb-0650-46bc-a18b-b54fbe329eb9" (UID: "3660e9eb-0650-46bc-a18b-b54fbe329eb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.089927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089805    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.089927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089823    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.089927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.089837    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.091560 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.091528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-dshm" (OuterVolumeSpecName: "dshm") pod "3660e9eb-0650-46bc-a18b-b54fbe329eb9" (UID: "3660e9eb-0650-46bc-a18b-b54fbe329eb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.091560 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.091529    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3660e9eb-0650-46bc-a18b-b54fbe329eb9-kube-api-access-6d5tp" (OuterVolumeSpecName: "kube-api-access-6d5tp") pod "3660e9eb-0650-46bc-a18b-b54fbe329eb9" (UID: "3660e9eb-0650-46bc-a18b-b54fbe329eb9"). InnerVolumeSpecName "kube-api-access-6d5tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:19:22.091707 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.091615    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3660e9eb-0650-46bc-a18b-b54fbe329eb9" (UID: "3660e9eb-0650-46bc-a18b-b54fbe329eb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:19:22.190889 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.190866    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d5tp\" (UniqueName: \"kubernetes.io/projected/3660e9eb-0650-46bc-a18b-b54fbe329eb9-kube-api-access-6d5tp\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.190889 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.190889    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3660e9eb-0650-46bc-a18b-b54fbe329eb9-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.191030 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.190901    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3660e9eb-0650-46bc-a18b-b54fbe329eb9-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.674490 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.674429    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh" podUID="40b778e0-acaf-419b-8708-08bf697a73e5" containerName="main" containerID="cri-o://61cfb8ddff5873cc00fce665124a6f706b2b19d669bd40f54514af8bbd8cd15a" gracePeriod=45
Jul 24 20:19:22.894820 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.894798    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"
Jul 24 20:19:22.894820 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.894804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh" event={"ID":"3660e9eb-0650-46bc-a18b-b54fbe329eb9","Type":"ContainerDied","Data":"8bcb089b45f20348ae196192d9068b321580a1c7ac962518149837554334b6d5"}
Jul 24 20:19:22.895028 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.894852    2560 scope.go:117] "RemoveContainer" containerID="6579e27674fbebc95c23efb9c7562d57f99c4eb055efbcc5071c9ab4ea6f6e3a"
Jul 24 20:19:22.896578 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.896520    2560 generic.go:356] "Generic (PLEG): container finished" podID="40b778e0-acaf-419b-8708-08bf697a73e5" containerID="61cfb8ddff5873cc00fce665124a6f706b2b19d669bd40f54514af8bbd8cd15a" exitCode=0
Jul 24 20:19:22.896578 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.896569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh" event={"ID":"40b778e0-acaf-419b-8708-08bf697a73e5","Type":"ContainerDied","Data":"61cfb8ddff5873cc00fce665124a6f706b2b19d669bd40f54514af8bbd8cd15a"}
Jul 24 20:19:22.912279 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.912256    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"]
Jul 24 20:19:22.916272 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.916246    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-53d0a0/rate-test-model-53d0a0-kserve-57b67bb84c-xrcrh"]
Jul 24 20:19:22.928305 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.928259    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:19:22.997181 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b778e0-acaf-419b-8708-08bf697a73e5-tls-certs\") pod \"40b778e0-acaf-419b-8708-08bf697a73e5\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") "
Jul 24 20:19:22.997305 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997211    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-home\") pod \"40b778e0-acaf-419b-8708-08bf697a73e5\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") "
Jul 24 20:19:22.997305 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997251    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrwkh\" (UniqueName: \"kubernetes.io/projected/40b778e0-acaf-419b-8708-08bf697a73e5-kube-api-access-qrwkh\") pod \"40b778e0-acaf-419b-8708-08bf697a73e5\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") "
Jul 24 20:19:22.997305 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-dshm\") pod \"40b778e0-acaf-419b-8708-08bf697a73e5\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") "
Jul 24 20:19:22.997491 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997328    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-tmp-dir\") pod \"40b778e0-acaf-419b-8708-08bf697a73e5\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") "
Jul 24 20:19:22.997491 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997386    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-model-cache\") pod \"40b778e0-acaf-419b-8708-08bf697a73e5\" (UID: \"40b778e0-acaf-419b-8708-08bf697a73e5\") "
Jul 24 20:19:22.997603 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997514    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-home" (OuterVolumeSpecName: "home") pod "40b778e0-acaf-419b-8708-08bf697a73e5" (UID: "40b778e0-acaf-419b-8708-08bf697a73e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.997654 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997604    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40b778e0-acaf-419b-8708-08bf697a73e5" (UID: "40b778e0-acaf-419b-8708-08bf697a73e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.997711 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997664    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "40b778e0-acaf-419b-8708-08bf697a73e5" (UID: "40b778e0-acaf-419b-8708-08bf697a73e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.997845 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997822    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.997845 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997844    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.997977 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.997858    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:22.999314 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.999211    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40b778e0-acaf-419b-8708-08bf697a73e5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40b778e0-acaf-419b-8708-08bf697a73e5" (UID: "40b778e0-acaf-419b-8708-08bf697a73e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:19:22.999314 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.999285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-dshm" (OuterVolumeSpecName: "dshm") pod "40b778e0-acaf-419b-8708-08bf697a73e5" (UID: "40b778e0-acaf-419b-8708-08bf697a73e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:19:22.999429 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:22.999330    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b778e0-acaf-419b-8708-08bf697a73e5-kube-api-access-qrwkh" (OuterVolumeSpecName: "kube-api-access-qrwkh") pod "40b778e0-acaf-419b-8708-08bf697a73e5" (UID: "40b778e0-acaf-419b-8708-08bf697a73e5"). InnerVolumeSpecName "kube-api-access-qrwkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:19:23.098498 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.098444    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrwkh\" (UniqueName: \"kubernetes.io/projected/40b778e0-acaf-419b-8708-08bf697a73e5-kube-api-access-qrwkh\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:23.098498 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.098495    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40b778e0-acaf-419b-8708-08bf697a73e5-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:23.098647 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.098506    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40b778e0-acaf-419b-8708-08bf697a73e5-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:23.904133 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.904109    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"
Jul 24 20:19:23.904636 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.904104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh" event={"ID":"40b778e0-acaf-419b-8708-08bf697a73e5","Type":"ContainerDied","Data":"1e4fb32a0212e64a717d8fab645b8b031e4ad5ded9473b0a63170da1dd23197b"}
Jul 24 20:19:23.904636 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.904226    2560 scope.go:117] "RemoveContainer" containerID="61cfb8ddff5873cc00fce665124a6f706b2b19d669bd40f54514af8bbd8cd15a"
Jul 24 20:19:23.924789 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.924768    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"]
Jul 24 20:19:23.934949 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:23.934925    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3f5fc9/rate-test-model-3f5fc9-kserve-9544df867-zwnhh"]
Jul 24 20:19:24.079938 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.079908    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7494-140052728624592"]
Jul 24 20:19:24.080381 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.080363    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b778e0-acaf-419b-8708-08bf697a73e5" containerName="main"
Jul 24 20:19:24.080496 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.080383    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b778e0-acaf-419b-8708-08bf697a73e5" containerName="main"
Jul 24 20:19:24.080496 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.080405    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3660e9eb-0650-46bc-a18b-b54fbe329eb9" containerName="main"
Jul 24 20:19:24.080496 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.080413    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3660e9eb-0650-46bc-a18b-b54fbe329eb9" containerName="main"
Jul 24 20:19:24.080655 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.080560    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b778e0-acaf-419b-8708-08bf697a73e5" containerName="main"
Jul 24 20:19:24.080655 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.080578    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3660e9eb-0650-46bc-a18b-b54fbe329eb9" containerName="main"
Jul 24 20:19:24.083623 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.083605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:24.086056 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.086039    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z47rd\""
Jul 24 20:19:24.090575 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.090555    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140052728624592"]
Jul 24 20:19:24.208938 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.208914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhgnc\" (UniqueName: \"kubernetes.io/projected/24201493-9c09-41dc-91c6-5047ca7381aa-kube-api-access-lhgnc\") pod \"test-curl-7494-140052728624592\" (UID: \"24201493-9c09-41dc-91c6-5047ca7381aa\") " pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:24.310130 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.310104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhgnc\" (UniqueName: \"kubernetes.io/projected/24201493-9c09-41dc-91c6-5047ca7381aa-kube-api-access-lhgnc\") pod \"test-curl-7494-140052728624592\" (UID: \"24201493-9c09-41dc-91c6-5047ca7381aa\") " pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:24.318681 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.318658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhgnc\" (UniqueName: \"kubernetes.io/projected/24201493-9c09-41dc-91c6-5047ca7381aa-kube-api-access-lhgnc\") pod \"test-curl-7494-140052728624592\" (UID: \"24201493-9c09-41dc-91c6-5047ca7381aa\") " pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:24.394475 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.394441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:24.522442 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.522422    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7494-140052728624592"]
Jul 24 20:19:24.524509 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:19:24.524483    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24201493_9c09_41dc_91c6_5047ca7381aa.slice/crio-a5a17161bf844e6b9b19b46b68b09cb68e39232f63dfd7b23df7d98a23755b7d WatchSource:0}: Error finding container a5a17161bf844e6b9b19b46b68b09cb68e39232f63dfd7b23df7d98a23755b7d: Status 404 returned error can't find the container with id a5a17161bf844e6b9b19b46b68b09cb68e39232f63dfd7b23df7d98a23755b7d
Jul 24 20:19:24.525874 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.525855    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 20:19:24.844344 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.844269    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3660e9eb-0650-46bc-a18b-b54fbe329eb9" path="/var/lib/kubelet/pods/3660e9eb-0650-46bc-a18b-b54fbe329eb9/volumes"
Jul 24 20:19:24.844717 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.844700    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b778e0-acaf-419b-8708-08bf697a73e5" path="/var/lib/kubelet/pods/40b778e0-acaf-419b-8708-08bf697a73e5/volumes"
Jul 24 20:19:24.912527 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:24.912499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140052728624592" event={"ID":"24201493-9c09-41dc-91c6-5047ca7381aa","Type":"ContainerStarted","Data":"a5a17161bf844e6b9b19b46b68b09cb68e39232f63dfd7b23df7d98a23755b7d"}
Jul 24 20:19:25.919434 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:25.919398    2560 generic.go:356] "Generic (PLEG): container finished" podID="24201493-9c09-41dc-91c6-5047ca7381aa" containerID="5bc3f743114ce870c161994c81459b98830ffac04a4f287e99a5d74c609e3d62" exitCode=0
Jul 24 20:19:25.919878 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:25.919486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7494-140052728624592" event={"ID":"24201493-9c09-41dc-91c6-5047ca7381aa","Type":"ContainerDied","Data":"5bc3f743114ce870c161994c81459b98830ffac04a4f287e99a5d74c609e3d62"}
Jul 24 20:19:27.057074 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.057049    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:27.076254 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.076232    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7494-140052728624592_24201493-9c09-41dc-91c6-5047ca7381aa/test-curl-7494-140052728624592/0.log"
Jul 24 20:19:27.101175 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.101149    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7494-140052728624592"]
Jul 24 20:19:27.104594 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.104571    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7494-140052728624592"]
Jul 24 20:19:27.135021 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.135000    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhgnc\" (UniqueName: \"kubernetes.io/projected/24201493-9c09-41dc-91c6-5047ca7381aa-kube-api-access-lhgnc\") pod \"24201493-9c09-41dc-91c6-5047ca7381aa\" (UID: \"24201493-9c09-41dc-91c6-5047ca7381aa\") "
Jul 24 20:19:27.137131 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.137108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24201493-9c09-41dc-91c6-5047ca7381aa-kube-api-access-lhgnc" (OuterVolumeSpecName: "kube-api-access-lhgnc") pod "24201493-9c09-41dc-91c6-5047ca7381aa" (UID: "24201493-9c09-41dc-91c6-5047ca7381aa"). InnerVolumeSpecName "kube-api-access-lhgnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:19:27.235963 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.235910    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhgnc\" (UniqueName: \"kubernetes.io/projected/24201493-9c09-41dc-91c6-5047ca7381aa-kube-api-access-lhgnc\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:19:27.609995 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.609892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:27.929836 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.929806    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:27.929992 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.929852    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5a17161bf844e6b9b19b46b68b09cb68e39232f63dfd7b23df7d98a23755b7d"
Jul 24 20:19:27.940431 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:19:27.940404    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7494-140052728624592\" is forbidden: User \"system:node:ip-10-0-130-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-158.ec2.internal' and this object" podUID="24201493-9c09-41dc-91c6-5047ca7381aa" pod="opendatahub/test-curl-7494-140052728624592"
Jul 24 20:19:27.942316 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:27.942292    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:28.251406 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:28.251339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:28.843423 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:28.843390    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24201493-9c09-41dc-91c6-5047ca7381aa" path="/var/lib/kubelet/pods/24201493-9c09-41dc-91c6-5047ca7381aa/volumes"
Jul 24 20:19:31.033899 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.033863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:31.130140 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.130112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:31.230112 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.230086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:31.695513 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.695478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:31.794380 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.794348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:31.872328 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.872293    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:31.872631 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.872612    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"]
Jul 24 20:19:31.873014 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.873002    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24201493-9c09-41dc-91c6-5047ca7381aa" containerName="test-curl-7494-140052728624592"
Jul 24 20:19:31.873055 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.873016    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="24201493-9c09-41dc-91c6-5047ca7381aa" containerName="test-curl-7494-140052728624592"
Jul 24 20:19:31.873090 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.873070    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="24201493-9c09-41dc-91c6-5047ca7381aa" containerName="test-curl-7494-140052728624592"
Jul 24 20:19:31.876402 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.876388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:31.878872 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.878847    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-937547-dockercfg-mw888\""
Jul 24 20:19:31.879000 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.878853    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-937547\""
Jul 24 20:19:31.885486 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.885442    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"]
Jul 24 20:19:31.943480 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.943444    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"]
Jul 24 20:19:31.946917 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.946861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:31.954749 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.954727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"]
Jul 24 20:19:31.978756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.978733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xnh8\" (UniqueName: \"kubernetes.io/projected/4d142154-6c5e-4188-a737-0aa57bebd149-kube-api-access-6xnh8\") pod \"payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:31.978855 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:31.978780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d142154-6c5e-4188-a737-0aa57bebd149-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.079473 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.079422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d142154-6c5e-4188-a737-0aa57bebd149-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.079777 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.079499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlk8k\" (UniqueName: \"kubernetes.io/projected/5e5b274b-fe5b-4fa3-a187-efda2014b36c-kube-api-access-jlk8k\") pod \"payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.079777 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.079523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5b274b-fe5b-4fa3-a187-efda2014b36c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.079777 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.079578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xnh8\" (UniqueName: \"kubernetes.io/projected/4d142154-6c5e-4188-a737-0aa57bebd149-kube-api-access-6xnh8\") pod \"payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.080105 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.080086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d142154-6c5e-4188-a737-0aa57bebd149-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.087729 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.087706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xnh8\" (UniqueName: \"kubernetes.io/projected/4d142154-6c5e-4188-a737-0aa57bebd149-kube-api-access-6xnh8\") pod \"payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.180483 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.180438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlk8k\" (UniqueName: \"kubernetes.io/projected/5e5b274b-fe5b-4fa3-a187-efda2014b36c-kube-api-access-jlk8k\") pod \"payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.180586 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.180491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5b274b-fe5b-4fa3-a187-efda2014b36c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.181100 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.181082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5b274b-fe5b-4fa3-a187-efda2014b36c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.187334 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.187315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.188070 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.188050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlk8k\" (UniqueName: \"kubernetes.io/projected/5e5b274b-fe5b-4fa3-a187-efda2014b36c-kube-api-access-jlk8k\") pod \"payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.256772 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.256747    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.334508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.334472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"]
Jul 24 20:19:32.343887 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:19:32.343856    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d142154_6c5e_4188_a737_0aa57bebd149.slice/crio-bd6878a56295e995c277ab6b23bd447843fc28640f5babc2d943821463499919 WatchSource:0}: Error finding container bd6878a56295e995c277ab6b23bd447843fc28640f5babc2d943821463499919: Status 404 returned error can't find the container with id bd6878a56295e995c277ab6b23bd447843fc28640f5babc2d943821463499919
Jul 24 20:19:32.609632 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.609610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"]
Jul 24 20:19:32.611121 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:19:32.611094    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5b274b_fe5b_4fa3_a187_efda2014b36c.slice/crio-96fe5dec89e29ec11107d734c813ce03113cbe9ad166cca75309270c3413993f WatchSource:0}: Error finding container 96fe5dec89e29ec11107d734c813ce03113cbe9ad166cca75309270c3413993f: Status 404 returned error can't find the container with id 96fe5dec89e29ec11107d734c813ce03113cbe9ad166cca75309270c3413993f
Jul 24 20:19:32.956744 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.956709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k" event={"ID":"4d142154-6c5e-4188-a737-0aa57bebd149","Type":"ContainerStarted","Data":"c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8"}
Jul 24 20:19:32.956926 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.956767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k" event={"ID":"4d142154-6c5e-4188-a737-0aa57bebd149","Type":"ContainerStarted","Data":"bd6878a56295e995c277ab6b23bd447843fc28640f5babc2d943821463499919"}
Jul 24 20:19:32.956926 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.956811    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:32.958365 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.958336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9" event={"ID":"5e5b274b-fe5b-4fa3-a187-efda2014b36c","Type":"ContainerStarted","Data":"b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad"}
Jul 24 20:19:32.958478 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.958370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9" event={"ID":"5e5b274b-fe5b-4fa3-a187-efda2014b36c","Type":"ContainerStarted","Data":"96fe5dec89e29ec11107d734c813ce03113cbe9ad166cca75309270c3413993f"}
Jul 24 20:19:32.958478 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.958406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:32.973542 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.973499    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k" podStartSLOduration=1.973488819 podStartE2EDuration="1.973488819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:19:32.972002357 +0000 UTC m=+2686.616265410" watchObservedRunningTime="2026-07-24 20:19:32.973488819 +0000 UTC m=+2686.617751893"
Jul 24 20:19:32.986262 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:32.986220    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9" podStartSLOduration=1.9862026400000001 podStartE2EDuration="1.98620264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:19:32.985553399 +0000 UTC m=+2686.629816440" watchObservedRunningTime="2026-07-24 20:19:32.98620264 +0000 UTC m=+2686.630465683"
Jul 24 20:19:35.516239 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:35.516209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:40.309287 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:40.309201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:19:43.965166 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:43.965138    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:19:43.965657 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:43.965398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:19:46.410189 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:46.410149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:46.741545 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:46.741407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:47.214041 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:47.214015    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:50.213477 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:50.213415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:50.294316 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:50.294285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:50.374748 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:50.374718    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:50.802940 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:50.802907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:50.904352 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:50.904321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:51.036721 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.036692    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"]
Jul 24 20:19:51.041578 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.041562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.044702 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.044682    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-307a30-dockercfg-gf8vg\""
Jul 24 20:19:51.044806 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.044720    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-307a30\""
Jul 24 20:19:51.052077 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.052061    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"]
Jul 24 20:19:51.135134 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.135069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6888f77-0b6a-4506-a797-f4b94a7b2358-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.135134 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.135117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8cx\" (UniqueName: \"kubernetes.io/projected/b6888f77-0b6a-4506-a797-f4b94a7b2358-kube-api-access-mc8cx\") pod \"payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.235715 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.235689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6888f77-0b6a-4506-a797-f4b94a7b2358-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.236022 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.235730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8cx\" (UniqueName: \"kubernetes.io/projected/b6888f77-0b6a-4506-a797-f4b94a7b2358-kube-api-access-mc8cx\") pod \"payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.236357 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.236338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6888f77-0b6a-4506-a797-f4b94a7b2358-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.243822 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.243798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8cx\" (UniqueName: \"kubernetes.io/projected/b6888f77-0b6a-4506-a797-f4b94a7b2358-kube-api-access-mc8cx\") pod \"payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.352436 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.352400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:51.442783 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.442752    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:19:51.692350 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:51.692327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"]
Jul 24 20:19:51.694393 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:19:51.694363    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6888f77_0b6a_4506_a797_f4b94a7b2358.slice/crio-a359cae568b33dc737de03751f2e8b9334bb931b8e132b37f796cabfff960509 WatchSource:0}: Error finding container a359cae568b33dc737de03751f2e8b9334bb931b8e132b37f796cabfff960509: Status 404 returned error can't find the container with id a359cae568b33dc737de03751f2e8b9334bb931b8e132b37f796cabfff960509
Jul 24 20:19:52.054243 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:52.054157    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8" event={"ID":"b6888f77-0b6a-4506-a797-f4b94a7b2358","Type":"ContainerStarted","Data":"cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068"}
Jul 24 20:19:52.054243 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:52.054208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8" event={"ID":"b6888f77-0b6a-4506-a797-f4b94a7b2358","Type":"ContainerStarted","Data":"a359cae568b33dc737de03751f2e8b9334bb931b8e132b37f796cabfff960509"}
Jul 24 20:19:52.054482 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:52.054303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:19:52.070627 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:52.070570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8" podStartSLOduration=1.070552275 podStartE2EDuration="1.070552275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:19:52.06979875 +0000 UTC m=+2705.714061790" watchObservedRunningTime="2026-07-24 20:19:52.070552275 +0000 UTC m=+2705.714815351"
Jul 24 20:19:54.645848 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:19:54.645809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:00.811882 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:00.811845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:20:03.061355 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:03.061324    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:20:11.734211 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:11.734181    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-84npd_4f2c48f6-1b66-440d-a848-5af660395855/payload-processing/0.log"
Jul 24 20:20:19.405210 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.405170    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"]
Jul 24 20:20:19.410347 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.410325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.413974 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.413949    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-937547\"/\"ipp-route-937547-kserve-self-signed-certs\""
Jul 24 20:20:19.414162 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.414135    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-937547\"/\"openshift-service-ca.crt\""
Jul 24 20:20:19.414333 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.414066    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-937547\"/\"kube-root-ca.crt\""
Jul 24 20:20:19.414333 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.413957    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-937547\"/\"default-dockercfg-9vppw\""
Jul 24 20:20:19.417156 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.417116    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"]
Jul 24 20:20:19.431881 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.431850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:19.480646 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.480613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-model-cache\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.480807 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.480663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-dshm\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.480807 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.480755    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-home\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.480807 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.480795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5jr\" (UniqueName: \"kubernetes.io/projected/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-kube-api-access-cl5jr\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.480935 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.480837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tls-certs\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.480935 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.480877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tmp-dir\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.581791 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.581756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-dshm\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.581791 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.581795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-home\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582047 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.581832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5jr\" (UniqueName: \"kubernetes.io/projected/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-kube-api-access-cl5jr\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582047 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.581883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tls-certs\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582047 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.581957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tmp-dir\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582209 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.582049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-model-cache\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582298 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.582276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-home\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582354 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.582324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-model-cache\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.582490 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.582448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tmp-dir\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.584125 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.584099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-dshm\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.584414 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.584397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tls-certs\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.589452 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.589422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5jr\" (UniqueName: \"kubernetes.io/projected/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-kube-api-access-cl5jr\") pod \"ipp-route-937547-kserve-6fccfcb55f-kpq9h\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") " pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.720643 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.720605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:19.852688 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:19.852664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"]
Jul 24 20:20:19.859092 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:20:19.857722    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5a88d66_d99a_4c88_9f12_b3e1d68f50e9.slice/crio-13cd201edc381036f58a31cacc6b1726aab78d17ee4fc2d42164c45013e06333 WatchSource:0}: Error finding container 13cd201edc381036f58a31cacc6b1726aab78d17ee4fc2d42164c45013e06333: Status 404 returned error can't find the container with id 13cd201edc381036f58a31cacc6b1726aab78d17ee4fc2d42164c45013e06333
Jul 24 20:20:20.200523 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:20.200487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h" event={"ID":"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9","Type":"ContainerStarted","Data":"0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781"}
Jul 24 20:20:20.200674 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:20.200531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h" event={"ID":"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9","Type":"ContainerStarted","Data":"13cd201edc381036f58a31cacc6b1726aab78d17ee4fc2d42164c45013e06333"}
Jul 24 20:20:20.215982 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:20.215935    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h" podStartSLOduration=1.215917352 podStartE2EDuration="1.215917352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:20:20.215528782 +0000 UTC m=+2733.859791824" watchObservedRunningTime="2026-07-24 20:20:20.215917352 +0000 UTC m=+2733.860180395"
Jul 24 20:20:23.609702 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:23.609669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:20:29.720829 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:29.720792    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:29.720829 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:29.720837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:29.733246 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:29.733224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:30.260292 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:30.260263    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:20:41.923754 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:41.923717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:20:53.426083 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:53.426058    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k_4d142154-6c5e-4188-a737-0aa57bebd149/payload-processing/0.log"
Jul 24 20:20:53.549143 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:53.549117    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-84npd_4f2c48f6-1b66-440d-a848-5af660395855/payload-processing/0.log"
Jul 24 20:20:53.941438 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:53.941404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:54.244934 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:54.244867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:54.368752 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:54.368716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:57.471721 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:57.471687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:57.556821 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:57.556795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:57.628056 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:57.628017    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:57.737393 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:57.737308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:58.385339 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.385309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:58.479953 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.479922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:20:58.546275 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.546246    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"]
Jul 24 20:20:58.549837 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.549820    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.552343 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.552322    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-712eee-dockercfg-jjx5z\""
Jul 24 20:20:58.552448 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.552403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-712eee\""
Jul 24 20:20:58.559375 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.559354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"]
Jul 24 20:20:58.607064 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.607038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscbw\" (UniqueName: \"kubernetes.io/projected/5e0a95e9-a970-49ce-855e-56bade553e10-kube-api-access-mscbw\") pod \"payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.607166 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.607148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0a95e9-a970-49ce-855e-56bade553e10-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.708089 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.708053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0a95e9-a970-49ce-855e-56bade553e10-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.708189 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.708108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscbw\" (UniqueName: \"kubernetes.io/projected/5e0a95e9-a970-49ce-855e-56bade553e10-kube-api-access-mscbw\") pod \"payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.708723 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.708706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0a95e9-a970-49ce-855e-56bade553e10-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.715405 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.715377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscbw\" (UniqueName: \"kubernetes.io/projected/5e0a95e9-a970-49ce-855e-56bade553e10-kube-api-access-mscbw\") pod \"payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.861621 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.861594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:58.993430 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:58.993407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"]
Jul 24 20:20:58.995922 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:20:58.995897    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0a95e9_a970_49ce_855e_56bade553e10.slice/crio-dd66208e452303c6766f32e7e8e561b7eeb7e68893c8cf2332a5b01525d11b53 WatchSource:0}: Error finding container dd66208e452303c6766f32e7e8e561b7eeb7e68893c8cf2332a5b01525d11b53: Status 404 returned error can't find the container with id dd66208e452303c6766f32e7e8e561b7eeb7e68893c8cf2332a5b01525d11b53
Jul 24 20:20:59.401261 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:59.401163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz" event={"ID":"5e0a95e9-a970-49ce-855e-56bade553e10","Type":"ContainerStarted","Data":"fe316c7de99e39eea05ae2a6ca31b24163cc35b6dda25d581e4d6ed707e448a1"}
Jul 24 20:20:59.401261 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:59.401230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:20:59.401261 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:59.401254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz" event={"ID":"5e0a95e9-a970-49ce-855e-56bade553e10","Type":"ContainerStarted","Data":"dd66208e452303c6766f32e7e8e561b7eeb7e68893c8cf2332a5b01525d11b53"}
Jul 24 20:20:59.416230 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:20:59.416180    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz" podStartSLOduration=1.416164955 podStartE2EDuration="1.416164955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:20:59.415539097 +0000 UTC m=+2773.059802138" watchObservedRunningTime="2026-07-24 20:20:59.416164955 +0000 UTC m=+2773.060427994"
Jul 24 20:21:02.081237 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:02.081201    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:03.416292 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:03.416261    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:21:10.409260 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:10.409187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:21:12.846485 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:12.846426    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"]
Jul 24 20:21:12.850373 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:12.850352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:12.852752 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:12.852735    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:21:12.852852 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:12.852812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:21:12.856623 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:12.856601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"]
Jul 24 20:21:12.926846 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:12.926822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t\" (UID: \"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:13.027396 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:13.027368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t\" (UID: \"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:13.027975 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:13.027956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t\" (UID: \"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:13.162196 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:13.162179    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:13.495232 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:13.495208    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"]
Jul 24 20:21:13.496914 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:21:13.496884    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72c2f1b_8b1e_4803_9daa_d8c3a37fb8e2.slice/crio-e4e2197e2e5a829b3ec51bccded17a137d9655b50a9cab8627a7aa2a3edfa538 WatchSource:0}: Error finding container e4e2197e2e5a829b3ec51bccded17a137d9655b50a9cab8627a7aa2a3edfa538: Status 404 returned error can't find the container with id e4e2197e2e5a829b3ec51bccded17a137d9655b50a9cab8627a7aa2a3edfa538
Jul 24 20:21:14.486354 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:14.486284    2560 generic.go:356] "Generic (PLEG): container finished" podID="e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2" containerID="d72d17bf26a8b3223ec822132f5d1eb5ffff8c27789bca098595ed080ed11a97" exitCode=0
Jul 24 20:21:14.486354 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:14.486342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t" event={"ID":"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2","Type":"ContainerDied","Data":"d72d17bf26a8b3223ec822132f5d1eb5ffff8c27789bca098595ed080ed11a97"}
Jul 24 20:21:14.486750 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:14.486418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t" event={"ID":"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2","Type":"ContainerStarted","Data":"e4e2197e2e5a829b3ec51bccded17a137d9655b50a9cab8627a7aa2a3edfa538"}
Jul 24 20:21:15.623352 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:15.623328    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:15.758234 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:15.758167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2-maas-api-service-ca\") pod \"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2\" (UID: \"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2\") "
Jul 24 20:21:15.758515 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:15.758495    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2" (UID: "e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:21:15.859301 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:15.859278    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2-maas-api-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:16.497679 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:16.497649    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"
Jul 24 20:21:16.497865 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:16.497679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t" event={"ID":"e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2","Type":"ContainerDied","Data":"e4e2197e2e5a829b3ec51bccded17a137d9655b50a9cab8627a7aa2a3edfa538"}
Jul 24 20:21:16.497865 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:16.497728    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4e2197e2e5a829b3ec51bccded17a137d9655b50a9cab8627a7aa2a3edfa538"
Jul 24 20:21:23.340240 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.340204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:23.388284 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.388253    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"]
Jul 24 20:21:23.388528 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.388482    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz" podUID="5e0a95e9-a970-49ce-855e-56bade553e10" containerName="payload-pre-processing" containerID="cri-o://fe316c7de99e39eea05ae2a6ca31b24163cc35b6dda25d581e4d6ed707e448a1" gracePeriod=30
Jul 24 20:21:23.442397 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.442368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:23.537857 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.537828    2560 generic.go:356] "Generic (PLEG): container finished" podID="5e0a95e9-a970-49ce-855e-56bade553e10" containerID="fe316c7de99e39eea05ae2a6ca31b24163cc35b6dda25d581e4d6ed707e448a1" exitCode=0
Jul 24 20:21:23.537969 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.537878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz" event={"ID":"5e0a95e9-a970-49ce-855e-56bade553e10","Type":"ContainerDied","Data":"fe316c7de99e39eea05ae2a6ca31b24163cc35b6dda25d581e4d6ed707e448a1"}
Jul 24 20:21:23.545177 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.545152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:23.639610 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.639586    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:21:23.728982 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.728955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0a95e9-a970-49ce-855e-56bade553e10-plugins-config-volume\") pod \"5e0a95e9-a970-49ce-855e-56bade553e10\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") "
Jul 24 20:21:23.729152 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.729135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mscbw\" (UniqueName: \"kubernetes.io/projected/5e0a95e9-a970-49ce-855e-56bade553e10-kube-api-access-mscbw\") pod \"5e0a95e9-a970-49ce-855e-56bade553e10\" (UID: \"5e0a95e9-a970-49ce-855e-56bade553e10\") "
Jul 24 20:21:23.729353 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.729333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e0a95e9-a970-49ce-855e-56bade553e10-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e0a95e9-a970-49ce-855e-56bade553e10" (UID: "5e0a95e9-a970-49ce-855e-56bade553e10"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:21:23.729441 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.729429    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0a95e9-a970-49ce-855e-56bade553e10-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:23.731065 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.731036    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e0a95e9-a970-49ce-855e-56bade553e10-kube-api-access-mscbw" (OuterVolumeSpecName: "kube-api-access-mscbw") pod "5e0a95e9-a970-49ce-855e-56bade553e10" (UID: "5e0a95e9-a970-49ce-855e-56bade553e10"). InnerVolumeSpecName "kube-api-access-mscbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:21:23.830687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:23.830667    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mscbw\" (UniqueName: \"kubernetes.io/projected/5e0a95e9-a970-49ce-855e-56bade553e10-kube-api-access-mscbw\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:24.544070 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:24.544043    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"
Jul 24 20:21:24.544604 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:24.544038    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz" event={"ID":"5e0a95e9-a970-49ce-855e-56bade553e10","Type":"ContainerDied","Data":"dd66208e452303c6766f32e7e8e561b7eeb7e68893c8cf2332a5b01525d11b53"}
Jul 24 20:21:24.544604 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:24.544177    2560 scope.go:117] "RemoveContainer" containerID="fe316c7de99e39eea05ae2a6ca31b24163cc35b6dda25d581e4d6ed707e448a1"
Jul 24 20:21:24.567411 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:24.567388    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"]
Jul 24 20:21:24.570991 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:24.570971    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-712eee-6fc67c9556-cgkxz"]
Jul 24 20:21:24.843351 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:24.843283    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e0a95e9-a970-49ce-855e-56bade553e10" path="/var/lib/kubelet/pods/5e0a95e9-a970-49ce-855e-56bade553e10/volumes"
Jul 24 20:21:27.924982 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:27.924949    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"]
Jul 24 20:21:27.925942 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:27.925918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:27.927124 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:27.927106    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-712eee-tsm9t"]
Jul 24 20:21:28.114189 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:28.114160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:21:28.295731 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:28.295666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:28.842367 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:28.842334    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2" path="/var/lib/kubelet/pods/e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2/volumes"
Jul 24 20:21:33.881977 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:33.881943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:33.982857 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:33.982829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:34.131835 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:34.131807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:34.354125 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:34.354094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:37.616767 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.616739    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"]
Jul 24 20:21:37.617138 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.617126    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e0a95e9-a970-49ce-855e-56bade553e10" containerName="payload-pre-processing"
Jul 24 20:21:37.617182 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.617140    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0a95e9-a970-49ce-855e-56bade553e10" containerName="payload-pre-processing"
Jul 24 20:21:37.617182 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.617172    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2" containerName="revoke-keys"
Jul 24 20:21:37.617182 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.617178    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2" containerName="revoke-keys"
Jul 24 20:21:37.617279 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.617238    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e0a95e9-a970-49ce-855e-56bade553e10" containerName="payload-pre-processing"
Jul 24 20:21:37.617279 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.617247    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e72c2f1b-8b1e-4803-9daa-d8c3a37fb8e2" containerName="revoke-keys"
Jul 24 20:21:37.620134 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.620118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:37.623117 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.623052    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:21:37.623117 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.623059    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:21:37.629810 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.629778    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"]
Jul 24 20:21:37.738508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.738481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bad864-2dfd-4730-ac94-869a9678b4ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9\" (UID: \"f8bad864-2dfd-4730-ac94-869a9678b4ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:37.839735 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.839706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bad864-2dfd-4730-ac94-869a9678b4ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9\" (UID: \"f8bad864-2dfd-4730-ac94-869a9678b4ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:37.840332 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.840313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bad864-2dfd-4730-ac94-869a9678b4ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9\" (UID: \"f8bad864-2dfd-4730-ac94-869a9678b4ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:37.938899 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:37.938870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:38.144781 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:38.144745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:38.245547 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:38.245475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:38.274927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:38.274907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"]
Jul 24 20:21:38.277156 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:21:38.277132    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bad864_2dfd_4730_ac94_869a9678b4ac.slice/crio-c28f01c6af7f3299fd8f9eae669ef040c1837136efa8b4a995163d1e9c8182b7 WatchSource:0}: Error finding container c28f01c6af7f3299fd8f9eae669ef040c1837136efa8b4a995163d1e9c8182b7: Status 404 returned error can't find the container with id c28f01c6af7f3299fd8f9eae669ef040c1837136efa8b4a995163d1e9c8182b7
Jul 24 20:21:38.621965 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:38.621939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9" event={"ID":"f8bad864-2dfd-4730-ac94-869a9678b4ac","Type":"ContainerStarted","Data":"0299fe1ff1b3cdedf8dc77e5c29ec6d6cce03922f9a7cbb601509ef32bc8721d"}
Jul 24 20:21:38.622268 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:38.621990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9" event={"ID":"f8bad864-2dfd-4730-ac94-869a9678b4ac","Type":"ContainerStarted","Data":"c28f01c6af7f3299fd8f9eae669ef040c1837136efa8b4a995163d1e9c8182b7"}
Jul 24 20:21:38.636972 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:38.636930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9" podStartSLOduration=1.6369158879999999 podStartE2EDuration="1.636915888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:21:38.63506208 +0000 UTC m=+2812.279325132" watchObservedRunningTime="2026-07-24 20:21:38.636915888 +0000 UTC m=+2812.281178928"
Jul 24 20:21:39.628352 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:39.628317    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8bad864-2dfd-4730-ac94-869a9678b4ac" containerID="0299fe1ff1b3cdedf8dc77e5c29ec6d6cce03922f9a7cbb601509ef32bc8721d" exitCode=0
Jul 24 20:21:39.628745 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:39.628402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9" event={"ID":"f8bad864-2dfd-4730-ac94-869a9678b4ac","Type":"ContainerDied","Data":"0299fe1ff1b3cdedf8dc77e5c29ec6d6cce03922f9a7cbb601509ef32bc8721d"}
Jul 24 20:21:40.769845 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:40.769819    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:40.864956 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:40.864929    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bad864-2dfd-4730-ac94-869a9678b4ac-maas-api-service-ca\") pod \"f8bad864-2dfd-4730-ac94-869a9678b4ac\" (UID: \"f8bad864-2dfd-4730-ac94-869a9678b4ac\") "
Jul 24 20:21:40.865250 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:40.865227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bad864-2dfd-4730-ac94-869a9678b4ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8bad864-2dfd-4730-ac94-869a9678b4ac" (UID: "f8bad864-2dfd-4730-ac94-869a9678b4ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:21:40.966308 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:40.966284    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bad864-2dfd-4730-ac94-869a9678b4ac-maas-api-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:41.640345 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:41.640318    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"
Jul 24 20:21:41.640345 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:41.640326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9" event={"ID":"f8bad864-2dfd-4730-ac94-869a9678b4ac","Type":"ContainerDied","Data":"c28f01c6af7f3299fd8f9eae669ef040c1837136efa8b4a995163d1e9c8182b7"}
Jul 24 20:21:41.640572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:41.640368    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c28f01c6af7f3299fd8f9eae669ef040c1837136efa8b4a995163d1e9c8182b7"
Jul 24 20:21:52.017640 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:52.017598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:21:53.147224 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.147182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:53.178485 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.178435    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"]
Jul 24 20:21:53.178702 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.178671    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k" podUID="4d142154-6c5e-4188-a737-0aa57bebd149" containerName="payload-processing" containerID="cri-o://c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8" gracePeriod=30
Jul 24 20:21:53.184498 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.184466    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"]
Jul 24 20:21:53.184731 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.184689    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9" podUID="5e5b274b-fe5b-4fa3-a187-efda2014b36c" containerName="payload-pre-processing" containerID="cri-o://b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad" gracePeriod=30
Jul 24 20:21:53.215130 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.215097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:53.276375 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.276347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:53.470758 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.470736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:21:53.473647 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.473631    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:21:53.583540 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.583512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5b274b-fe5b-4fa3-a187-efda2014b36c-plugins-config-volume\") pod \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") "
Jul 24 20:21:53.583540 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.583542    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d142154-6c5e-4188-a737-0aa57bebd149-plugins-config-volume\") pod \"4d142154-6c5e-4188-a737-0aa57bebd149\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") "
Jul 24 20:21:53.583714 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.583588    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlk8k\" (UniqueName: \"kubernetes.io/projected/5e5b274b-fe5b-4fa3-a187-efda2014b36c-kube-api-access-jlk8k\") pod \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\" (UID: \"5e5b274b-fe5b-4fa3-a187-efda2014b36c\") "
Jul 24 20:21:53.583714 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.583613    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xnh8\" (UniqueName: \"kubernetes.io/projected/4d142154-6c5e-4188-a737-0aa57bebd149-kube-api-access-6xnh8\") pod \"4d142154-6c5e-4188-a737-0aa57bebd149\" (UID: \"4d142154-6c5e-4188-a737-0aa57bebd149\") "
Jul 24 20:21:53.584006 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.583974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d142154-6c5e-4188-a737-0aa57bebd149-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d142154-6c5e-4188-a737-0aa57bebd149" (UID: "4d142154-6c5e-4188-a737-0aa57bebd149"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:21:53.584119 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.584009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e5b274b-fe5b-4fa3-a187-efda2014b36c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e5b274b-fe5b-4fa3-a187-efda2014b36c" (UID: "5e5b274b-fe5b-4fa3-a187-efda2014b36c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:21:53.585652 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.585634    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d142154-6c5e-4188-a737-0aa57bebd149-kube-api-access-6xnh8" (OuterVolumeSpecName: "kube-api-access-6xnh8") pod "4d142154-6c5e-4188-a737-0aa57bebd149" (UID: "4d142154-6c5e-4188-a737-0aa57bebd149"). InnerVolumeSpecName "kube-api-access-6xnh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:21:53.585734 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.585645    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e5b274b-fe5b-4fa3-a187-efda2014b36c-kube-api-access-jlk8k" (OuterVolumeSpecName: "kube-api-access-jlk8k") pod "5e5b274b-fe5b-4fa3-a187-efda2014b36c" (UID: "5e5b274b-fe5b-4fa3-a187-efda2014b36c"). InnerVolumeSpecName "kube-api-access-jlk8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:21:53.684294 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.684272    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlk8k\" (UniqueName: \"kubernetes.io/projected/5e5b274b-fe5b-4fa3-a187-efda2014b36c-kube-api-access-jlk8k\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:53.684294 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.684293    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xnh8\" (UniqueName: \"kubernetes.io/projected/4d142154-6c5e-4188-a737-0aa57bebd149-kube-api-access-6xnh8\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:53.684426 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.684303    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e5b274b-fe5b-4fa3-a187-efda2014b36c-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:53.684426 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.684313    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d142154-6c5e-4188-a737-0aa57bebd149-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:21:53.706320 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.706265    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d142154-6c5e-4188-a737-0aa57bebd149" containerID="c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8" exitCode=0
Jul 24 20:21:53.706320 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.706312    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"
Jul 24 20:21:53.706450 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.706340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k" event={"ID":"4d142154-6c5e-4188-a737-0aa57bebd149","Type":"ContainerDied","Data":"c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8"}
Jul 24 20:21:53.706450 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.706386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k" event={"ID":"4d142154-6c5e-4188-a737-0aa57bebd149","Type":"ContainerDied","Data":"bd6878a56295e995c277ab6b23bd447843fc28640f5babc2d943821463499919"}
Jul 24 20:21:53.706450 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.706417    2560 scope.go:117] "RemoveContainer" containerID="c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8"
Jul 24 20:21:53.707619 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.707599    2560 generic.go:356] "Generic (PLEG): container finished" podID="5e5b274b-fe5b-4fa3-a187-efda2014b36c" containerID="b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad" exitCode=0
Jul 24 20:21:53.707727 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.707635    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"
Jul 24 20:21:53.707727 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.707660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9" event={"ID":"5e5b274b-fe5b-4fa3-a187-efda2014b36c","Type":"ContainerDied","Data":"b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad"}
Jul 24 20:21:53.707727 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.707693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9" event={"ID":"5e5b274b-fe5b-4fa3-a187-efda2014b36c","Type":"ContainerDied","Data":"96fe5dec89e29ec11107d734c813ce03113cbe9ad166cca75309270c3413993f"}
Jul 24 20:21:53.715324 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.715257    2560 scope.go:117] "RemoveContainer" containerID="c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8"
Jul 24 20:21:53.715579 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:21:53.715558    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8\": container with ID starting with c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8 not found: ID does not exist" containerID="c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8"
Jul 24 20:21:53.715654 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.715587    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8"} err="failed to get container status \"c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8\": rpc error: code = NotFound desc = could not find container \"c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8\": container with ID starting with c6fd3713b466bcb385f1000c4abda4947d99dd00095831a5c86e736b420424e8 not found: ID does not exist"
Jul 24 20:21:53.715654 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.715603    2560 scope.go:117] "RemoveContainer" containerID="b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad"
Jul 24 20:21:53.723600 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.723584    2560 scope.go:117] "RemoveContainer" containerID="b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad"
Jul 24 20:21:53.723837 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:21:53.723818    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad\": container with ID starting with b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad not found: ID does not exist" containerID="b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad"
Jul 24 20:21:53.723896 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.723845    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad"} err="failed to get container status \"b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad\": rpc error: code = NotFound desc = could not find container \"b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad\": container with ID starting with b00ef4ebf7281a1b7e5832602a7f20203ddd1d789c8b30c952f0dfbdca41a4ad not found: ID does not exist"
Jul 24 20:21:53.729816 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.729795    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"]
Jul 24 20:21:53.731726 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.731709    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-937547-5787467d64-t6bt9"]
Jul 24 20:21:53.741236 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.741215    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"]
Jul 24 20:21:53.744572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:53.744548    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-937547-656765fd9b-4mn4k"]
Jul 24 20:21:54.842379 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:54.842345    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d142154-6c5e-4188-a737-0aa57bebd149" path="/var/lib/kubelet/pods/4d142154-6c5e-4188-a737-0aa57bebd149/volumes"
Jul 24 20:21:54.842780 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:54.842723    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5b274b-fe5b-4fa3-a187-efda2014b36c" path="/var/lib/kubelet/pods/5e5b274b-fe5b-4fa3-a187-efda2014b36c/volumes"
Jul 24 20:21:57.698757 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:57.698690    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"]
Jul 24 20:21:57.700527 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:57.700502    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:57.700807 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:57.700789    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-937547-gg5r9"]
Jul 24 20:21:58.087350 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:58.087278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:21:58.842407 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:21:58.842373    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8bad864-2dfd-4730-ac94-869a9678b4ac" path="/var/lib/kubelet/pods/f8bad864-2dfd-4730-ac94-869a9678b4ac/volumes"
Jul 24 20:22:03.080542 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:03.080510    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"]
Jul 24 20:22:03.115733 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:03.115708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:22:03.173941 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:03.173917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:18.101988 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.101926    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h" podUID="b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" containerName="main" containerID="cri-o://0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781" gracePeriod=45
Jul 24 20:22:18.340756 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.340733    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:22:18.487167 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-model-cache\") pod \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") "
Jul 24 20:22:18.487167 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487171    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-home\") pod \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") "
Jul 24 20:22:18.487339 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487223    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tmp-dir\") pod \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") "
Jul 24 20:22:18.487339 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl5jr\" (UniqueName: \"kubernetes.io/projected/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-kube-api-access-cl5jr\") pod \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") "
Jul 24 20:22:18.487339 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487291    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-dshm\") pod \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") "
Jul 24 20:22:18.487339 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487319    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tls-certs\") pod \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\" (UID: \"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9\") "
Jul 24 20:22:18.487572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487423    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" (UID: "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:18.487572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-home" (OuterVolumeSpecName: "home") pod "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" (UID: "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:18.487572 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487533    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" (UID: "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:18.487736 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487653    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-model-cache\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:18.487736 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487666    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-home\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:18.487736 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.487674    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tmp-dir\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:18.489551 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.489521    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-dshm" (OuterVolumeSpecName: "dshm") pod "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" (UID: "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 20:22:18.489551 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.489524    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" (UID: "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 20:22:18.489696 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.489588    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-kube-api-access-cl5jr" (OuterVolumeSpecName: "kube-api-access-cl5jr") pod "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" (UID: "b5a88d66-d99a-4c88-9f12-b3e1d68f50e9"). InnerVolumeSpecName "kube-api-access-cl5jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:22:18.588820 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.588789    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl5jr\" (UniqueName: \"kubernetes.io/projected/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-kube-api-access-cl5jr\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:18.588820 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.588814    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-dshm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:18.588820 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.588825    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9-tls-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:18.835881 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.835793    2560 generic.go:356] "Generic (PLEG): container finished" podID="b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" containerID="0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781" exitCode=0
Jul 24 20:22:18.835881 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.835841    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"
Jul 24 20:22:18.836069 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.835881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h" event={"ID":"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9","Type":"ContainerDied","Data":"0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781"}
Jul 24 20:22:18.836069 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.835924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h" event={"ID":"b5a88d66-d99a-4c88-9f12-b3e1d68f50e9","Type":"ContainerDied","Data":"13cd201edc381036f58a31cacc6b1726aab78d17ee4fc2d42164c45013e06333"}
Jul 24 20:22:18.836069 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.835940    2560 scope.go:117] "RemoveContainer" containerID="0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781"
Jul 24 20:22:18.845781 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.845765    2560 scope.go:117] "RemoveContainer" containerID="0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781"
Jul 24 20:22:18.846048 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:22:18.846030    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781\": container with ID starting with 0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781 not found: ID does not exist" containerID="0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781"
Jul 24 20:22:18.846112 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.846056    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781"} err="failed to get container status \"0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781\": rpc error: code = NotFound desc = could not find container \"0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781\": container with ID starting with 0c391a5f4791b370aae215b2572d996f3e32df85d5bdb0b457a9041ed67ab781 not found: ID does not exist"
Jul 24 20:22:18.858007 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.857982    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"]
Jul 24 20:22:18.861623 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:18.861604    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-937547/ipp-route-937547-kserve-6fccfcb55f-kpq9h"]
Jul 24 20:22:20.847251 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:20.847169    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" path="/var/lib/kubelet/pods/b5a88d66-d99a-4c88-9f12-b3e1d68f50e9/volumes"
Jul 24 20:22:25.777202 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:25.777128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:39.679437 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:39.679350    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:39.877762 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:39.877732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:45.510196 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:45.510155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:50.993358 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:50.993302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:51.090589 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.090564    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:51.270651 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.270575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:51.503801 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.503764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:22:51.625199 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625127    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"]
Jul 24 20:22:51.625566 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625552    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d142154-6c5e-4188-a737-0aa57bebd149" containerName="payload-processing"
Jul 24 20:22:51.625615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625567    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d142154-6c5e-4188-a737-0aa57bebd149" containerName="payload-processing"
Jul 24 20:22:51.625615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625578    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bad864-2dfd-4730-ac94-869a9678b4ac" containerName="revoke-keys"
Jul 24 20:22:51.625615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625584    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bad864-2dfd-4730-ac94-869a9678b4ac" containerName="revoke-keys"
Jul 24 20:22:51.625615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625593    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5b274b-fe5b-4fa3-a187-efda2014b36c" containerName="payload-pre-processing"
Jul 24 20:22:51.625615 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625598    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5b274b-fe5b-4fa3-a187-efda2014b36c" containerName="payload-pre-processing"
Jul 24 20:22:51.625786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625620    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" containerName="main"
Jul 24 20:22:51.625786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625625    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" containerName="main"
Jul 24 20:22:51.625786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625685    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8bad864-2dfd-4730-ac94-869a9678b4ac" containerName="revoke-keys"
Jul 24 20:22:51.625786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625693    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5b274b-fe5b-4fa3-a187-efda2014b36c" containerName="payload-pre-processing"
Jul 24 20:22:51.625786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625699    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a88d66-d99a-4c88-9f12-b3e1d68f50e9" containerName="main"
Jul 24 20:22:51.625786 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.625707    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d142154-6c5e-4188-a737-0aa57bebd149" containerName="payload-processing"
Jul 24 20:22:51.629887 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.629871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:51.632564 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.632543    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:22:51.632681 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.632586    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:22:51.637273 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.637247    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"]
Jul 24 20:22:51.753196 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.753171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2332d63e-9b30-4612-95a0-c3128270bb6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn\" (UID: \"2332d63e-9b30-4612-95a0-c3128270bb6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:51.853895 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.853864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2332d63e-9b30-4612-95a0-c3128270bb6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn\" (UID: \"2332d63e-9b30-4612-95a0-c3128270bb6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:51.854401 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.854381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2332d63e-9b30-4612-95a0-c3128270bb6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn\" (UID: \"2332d63e-9b30-4612-95a0-c3128270bb6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:51.941767 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:51.941747    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:52.075713 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:52.075688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"]
Jul 24 20:22:52.078246 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:22:52.078219    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2332d63e_9b30_4612_95a0_c3128270bb6b.slice/crio-6360df4cc1bca27385c04f0f262243b062ee4c39fc0f7a9dd0b7fad3eb077fbb WatchSource:0}: Error finding container 6360df4cc1bca27385c04f0f262243b062ee4c39fc0f7a9dd0b7fad3eb077fbb: Status 404 returned error can't find the container with id 6360df4cc1bca27385c04f0f262243b062ee4c39fc0f7a9dd0b7fad3eb077fbb
Jul 24 20:22:53.019493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:53.019381    2560 generic.go:356] "Generic (PLEG): container finished" podID="2332d63e-9b30-4612-95a0-c3128270bb6b" containerID="e6b793f963f74d0251367bc02ed3e2eaa7c00ab0f89f6da4daab5aeeed6ac5f3" exitCode=0
Jul 24 20:22:53.019493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:53.019475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn" event={"ID":"2332d63e-9b30-4612-95a0-c3128270bb6b","Type":"ContainerDied","Data":"e6b793f963f74d0251367bc02ed3e2eaa7c00ab0f89f6da4daab5aeeed6ac5f3"}
Jul 24 20:22:53.019685 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:53.019528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn" event={"ID":"2332d63e-9b30-4612-95a0-c3128270bb6b","Type":"ContainerStarted","Data":"6360df4cc1bca27385c04f0f262243b062ee4c39fc0f7a9dd0b7fad3eb077fbb"}
Jul 24 20:22:54.156961 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:54.156941    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:54.280794 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:54.280734    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2332d63e-9b30-4612-95a0-c3128270bb6b-maas-api-service-ca\") pod \"2332d63e-9b30-4612-95a0-c3128270bb6b\" (UID: \"2332d63e-9b30-4612-95a0-c3128270bb6b\") "
Jul 24 20:22:54.281062 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:54.281041    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2332d63e-9b30-4612-95a0-c3128270bb6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2332d63e-9b30-4612-95a0-c3128270bb6b" (UID: "2332d63e-9b30-4612-95a0-c3128270bb6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:22:54.381810 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:54.381769    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2332d63e-9b30-4612-95a0-c3128270bb6b-maas-api-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:22:55.031097 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:55.031068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn" event={"ID":"2332d63e-9b30-4612-95a0-c3128270bb6b","Type":"ContainerDied","Data":"6360df4cc1bca27385c04f0f262243b062ee4c39fc0f7a9dd0b7fad3eb077fbb"}
Jul 24 20:22:55.031097 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:55.031093    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"
Jul 24 20:22:55.031292 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:22:55.031112    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6360df4cc1bca27385c04f0f262243b062ee4c39fc0f7a9dd0b7fad3eb077fbb"
Jul 24 20:23:02.106989 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.106943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:02.130148 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.130117    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"]
Jul 24 20:23:02.130402 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.130379    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8" podUID="b6888f77-0b6a-4506-a797-f4b94a7b2358" containerName="payload-pre-processing" containerID="cri-o://cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068" gracePeriod=30
Jul 24 20:23:02.206445 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.206422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:02.385347 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.385325    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:23:02.453217 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.453190    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc8cx\" (UniqueName: \"kubernetes.io/projected/b6888f77-0b6a-4506-a797-f4b94a7b2358-kube-api-access-mc8cx\") pod \"b6888f77-0b6a-4506-a797-f4b94a7b2358\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") "
Jul 24 20:23:02.453362 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.453230    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6888f77-0b6a-4506-a797-f4b94a7b2358-plugins-config-volume\") pod \"b6888f77-0b6a-4506-a797-f4b94a7b2358\" (UID: \"b6888f77-0b6a-4506-a797-f4b94a7b2358\") "
Jul 24 20:23:02.453627 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.453606    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6888f77-0b6a-4506-a797-f4b94a7b2358-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6888f77-0b6a-4506-a797-f4b94a7b2358" (UID: "b6888f77-0b6a-4506-a797-f4b94a7b2358"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:02.455169 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.455148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6888f77-0b6a-4506-a797-f4b94a7b2358-kube-api-access-mc8cx" (OuterVolumeSpecName: "kube-api-access-mc8cx") pod "b6888f77-0b6a-4506-a797-f4b94a7b2358" (UID: "b6888f77-0b6a-4506-a797-f4b94a7b2358"). InnerVolumeSpecName "kube-api-access-mc8cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:02.554748 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.554723    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc8cx\" (UniqueName: \"kubernetes.io/projected/b6888f77-0b6a-4506-a797-f4b94a7b2358-kube-api-access-mc8cx\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:02.554748 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:02.554749    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6888f77-0b6a-4506-a797-f4b94a7b2358-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:03.070343 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.070310    2560 generic.go:356] "Generic (PLEG): container finished" podID="b6888f77-0b6a-4506-a797-f4b94a7b2358" containerID="cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068" exitCode=0
Jul 24 20:23:03.070493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.070361    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"
Jul 24 20:23:03.070493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.070396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8" event={"ID":"b6888f77-0b6a-4506-a797-f4b94a7b2358","Type":"ContainerDied","Data":"cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068"}
Jul 24 20:23:03.070493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.070443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8" event={"ID":"b6888f77-0b6a-4506-a797-f4b94a7b2358","Type":"ContainerDied","Data":"a359cae568b33dc737de03751f2e8b9334bb931b8e132b37f796cabfff960509"}
Jul 24 20:23:03.070493 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.070483    2560 scope.go:117] "RemoveContainer" containerID="cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068"
Jul 24 20:23:03.079259 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.079244    2560 scope.go:117] "RemoveContainer" containerID="cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068"
Jul 24 20:23:03.079513 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:23:03.079496    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068\": container with ID starting with cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068 not found: ID does not exist" containerID="cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068"
Jul 24 20:23:03.079567 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.079520    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068"} err="failed to get container status \"cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068\": rpc error: code = NotFound desc = could not find container \"cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068\": container with ID starting with cb52fe4d024ed0713f518254e469077667b26461650b2ed553d9ddee4fbbd068 not found: ID does not exist"
Jul 24 20:23:03.085713 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.085689    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"]
Jul 24 20:23:03.088089 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:03.088070    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-307a30-d879bb8d-qxcn8"]
Jul 24 20:23:04.842913 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:04.842877    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6888f77-0b6a-4506-a797-f4b94a7b2358" path="/var/lib/kubelet/pods/b6888f77-0b6a-4506-a797-f4b94a7b2358/volumes"
Jul 24 20:23:05.014385 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:05.014349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:23:05.949669 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:05.949629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:06.692910 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:06.692877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:06.703624 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:06.703593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"]
Jul 24 20:23:06.706150 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:06.706125    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-307a30-8xhnn"]
Jul 24 20:23:06.842790 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:06.842753    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2332d63e-9b30-4612-95a0-c3128270bb6b" path="/var/lib/kubelet/pods/2332d63e-9b30-4612-95a0-c3128270bb6b/volumes"
Jul 24 20:23:07.070992 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:07.070932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:12.765168 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:12.765131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:12.863440 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:12.863402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:13.029906 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.029830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:13.266819 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.266784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:13.410178 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410144    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"]
Jul 24 20:23:13.410639 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410622    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6888f77-0b6a-4506-a797-f4b94a7b2358" containerName="payload-pre-processing"
Jul 24 20:23:13.410746 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410641    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6888f77-0b6a-4506-a797-f4b94a7b2358" containerName="payload-pre-processing"
Jul 24 20:23:13.410746 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410661    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2332d63e-9b30-4612-95a0-c3128270bb6b" containerName="revoke-keys"
Jul 24 20:23:13.410746 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410669    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2332d63e-9b30-4612-95a0-c3128270bb6b" containerName="revoke-keys"
Jul 24 20:23:13.410898 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410765    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6888f77-0b6a-4506-a797-f4b94a7b2358" containerName="payload-pre-processing"
Jul 24 20:23:13.410898 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.410787    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2332d63e-9b30-4612-95a0-c3128270bb6b" containerName="revoke-keys"
Jul 24 20:23:13.415329 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.415309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:13.417948 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.417929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:23:13.418076 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.417964    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:23:13.421861 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.421837    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"]
Jul 24 20:23:13.552565 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.552536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5864ebe4-8bbc-4656-8e02-238b68b69062-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558\" (UID: \"5864ebe4-8bbc-4656-8e02-238b68b69062\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:13.652964 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.652934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5864ebe4-8bbc-4656-8e02-238b68b69062-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558\" (UID: \"5864ebe4-8bbc-4656-8e02-238b68b69062\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:13.653508 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.653492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5864ebe4-8bbc-4656-8e02-238b68b69062-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558\" (UID: \"5864ebe4-8bbc-4656-8e02-238b68b69062\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:13.726422 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.726355    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:13.862044 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:13.862008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"]
Jul 24 20:23:13.864054 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:23:13.864026    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5864ebe4_8bbc_4656_8e02_238b68b69062.slice/crio-6e56c88df1d6591e854f92fd51a36383f955f1a5fcdfa96f2faa1551e67a5da7 WatchSource:0}: Error finding container 6e56c88df1d6591e854f92fd51a36383f955f1a5fcdfa96f2faa1551e67a5da7: Status 404 returned error can't find the container with id 6e56c88df1d6591e854f92fd51a36383f955f1a5fcdfa96f2faa1551e67a5da7
Jul 24 20:23:14.128304 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:14.128270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558" event={"ID":"5864ebe4-8bbc-4656-8e02-238b68b69062","Type":"ContainerStarted","Data":"6e56c88df1d6591e854f92fd51a36383f955f1a5fcdfa96f2faa1551e67a5da7"}
Jul 24 20:23:15.134260 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:15.134226    2560 generic.go:356] "Generic (PLEG): container finished" podID="5864ebe4-8bbc-4656-8e02-238b68b69062" containerID="e6761f9b28bafba0bb908dcecb2e2ef8bb3816026364744c399e0fea58913d06" exitCode=0
Jul 24 20:23:15.134661 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:15.134277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558" event={"ID":"5864ebe4-8bbc-4656-8e02-238b68b69062","Type":"ContainerDied","Data":"e6761f9b28bafba0bb908dcecb2e2ef8bb3816026364744c399e0fea58913d06"}
Jul 24 20:23:16.273262 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:16.273240    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:16.377614 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:16.377584    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5864ebe4-8bbc-4656-8e02-238b68b69062-maas-api-service-ca\") pod \"5864ebe4-8bbc-4656-8e02-238b68b69062\" (UID: \"5864ebe4-8bbc-4656-8e02-238b68b69062\") "
Jul 24 20:23:16.377945 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:16.377923    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5864ebe4-8bbc-4656-8e02-238b68b69062-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5864ebe4-8bbc-4656-8e02-238b68b69062" (UID: "5864ebe4-8bbc-4656-8e02-238b68b69062"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:16.478529 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:16.478501    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5864ebe4-8bbc-4656-8e02-238b68b69062-maas-api-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:17.145856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:17.145781    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"
Jul 24 20:23:17.145856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:17.145797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558" event={"ID":"5864ebe4-8bbc-4656-8e02-238b68b69062","Type":"ContainerDied","Data":"6e56c88df1d6591e854f92fd51a36383f955f1a5fcdfa96f2faa1551e67a5da7"}
Jul 24 20:23:17.145856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:17.145845    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e56c88df1d6591e854f92fd51a36383f955f1a5fcdfa96f2faa1551e67a5da7"
Jul 24 20:23:23.854602 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:23.854573    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:23.922981 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:23.922951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:23.978158 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:23.978078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:26.817251 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:26.817215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:23:28.484120 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:28.484076    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"]
Jul 24 20:23:28.486042 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:28.486012    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-53d0a0-qx558"]
Jul 24 20:23:28.486177 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:28.486119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:28.843341 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:28.843259    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5864ebe4-8bbc-4656-8e02-238b68b69062" path="/var/lib/kubelet/pods/5864ebe4-8bbc-4656-8e02-238b68b69062/volumes"
Jul 24 20:23:28.854549 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:28.854519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:34.664062 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:34.664024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:34.719332 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:34.719303    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:34.914033 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:34.913985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:35.139539 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.139514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:35.256419 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.256394    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"]
Jul 24 20:23:35.256839 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.256816    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5864ebe4-8bbc-4656-8e02-238b68b69062" containerName="revoke-keys"
Jul 24 20:23:35.256839 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.256835    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5864ebe4-8bbc-4656-8e02-238b68b69062" containerName="revoke-keys"
Jul 24 20:23:35.257668 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.257644    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5864ebe4-8bbc-4656-8e02-238b68b69062" containerName="revoke-keys"
Jul 24 20:23:35.265511 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.265489    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:35.268725 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.268540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"]
Jul 24 20:23:35.268725 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.268722    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6fk9n\""
Jul 24 20:23:35.269076 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.269053    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 20:23:35.318533 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.318510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cbfcb-3a96-46b6-aeb1-cd94bec96b20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx\" (UID: \"719cbfcb-3a96-46b6-aeb1-cd94bec96b20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:35.419521 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.419500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cbfcb-3a96-46b6-aeb1-cd94bec96b20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx\" (UID: \"719cbfcb-3a96-46b6-aeb1-cd94bec96b20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:35.420042 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.420026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cbfcb-3a96-46b6-aeb1-cd94bec96b20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx\" (UID: \"719cbfcb-3a96-46b6-aeb1-cd94bec96b20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:35.578927 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.578901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:35.708988 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:35.708962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"]
Jul 24 20:23:35.711274 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:23:35.711248    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719cbfcb_3a96_46b6_aeb1_cd94bec96b20.slice/crio-79026ee704acbdc8f43a87d09594cf85885f728c00779adea692c4b20ea24c75 WatchSource:0}: Error finding container 79026ee704acbdc8f43a87d09594cf85885f728c00779adea692c4b20ea24c75: Status 404 returned error can't find the container with id 79026ee704acbdc8f43a87d09594cf85885f728c00779adea692c4b20ea24c75
Jul 24 20:23:36.254259 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:36.254188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx" event={"ID":"719cbfcb-3a96-46b6-aeb1-cd94bec96b20","Type":"ContainerStarted","Data":"d9d730a26e37baa5b9e660008e7d7c9b7a792f0aa6f1ceaf414dbb96596c11fe"}
Jul 24 20:23:36.254259 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:36.254243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx" event={"ID":"719cbfcb-3a96-46b6-aeb1-cd94bec96b20","Type":"ContainerStarted","Data":"79026ee704acbdc8f43a87d09594cf85885f728c00779adea692c4b20ea24c75"}
Jul 24 20:23:36.271687 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:36.271636    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx" podStartSLOduration=1.271624207 podStartE2EDuration="1.271624207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:23:36.268964971 +0000 UTC m=+2929.913228010" watchObservedRunningTime="2026-07-24 20:23:36.271624207 +0000 UTC m=+2929.915887247"
Jul 24 20:23:37.261051 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:37.261016    2560 generic.go:356] "Generic (PLEG): container finished" podID="719cbfcb-3a96-46b6-aeb1-cd94bec96b20" containerID="d9d730a26e37baa5b9e660008e7d7c9b7a792f0aa6f1ceaf414dbb96596c11fe" exitCode=0
Jul 24 20:23:37.261434 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:37.261086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx" event={"ID":"719cbfcb-3a96-46b6-aeb1-cd94bec96b20","Type":"ContainerDied","Data":"d9d730a26e37baa5b9e660008e7d7c9b7a792f0aa6f1ceaf414dbb96596c11fe"}
Jul 24 20:23:38.392399 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:38.392376    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:38.441014 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:38.440986    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cbfcb-3a96-46b6-aeb1-cd94bec96b20-maas-api-service-ca\") pod \"719cbfcb-3a96-46b6-aeb1-cd94bec96b20\" (UID: \"719cbfcb-3a96-46b6-aeb1-cd94bec96b20\") "
Jul 24 20:23:38.441316 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:38.441295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/719cbfcb-3a96-46b6-aeb1-cd94bec96b20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "719cbfcb-3a96-46b6-aeb1-cd94bec96b20" (UID: "719cbfcb-3a96-46b6-aeb1-cd94bec96b20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:38.542218 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:38.542167    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cbfcb-3a96-46b6-aeb1-cd94bec96b20-maas-api-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:39.271489 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:39.271449    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"
Jul 24 20:23:39.271489 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:39.271476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx" event={"ID":"719cbfcb-3a96-46b6-aeb1-cd94bec96b20","Type":"ContainerDied","Data":"79026ee704acbdc8f43a87d09594cf85885f728c00779adea692c4b20ea24c75"}
Jul 24 20:23:39.271765 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:39.271524    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79026ee704acbdc8f43a87d09594cf85885f728c00779adea692c4b20ea24c75"
Jul 24 20:23:45.864285 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:45.864253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:45.888566 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:45.888538    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"]
Jul 24 20:23:45.888782 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:45.888756    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx" podUID="e9fe0321-695e-44f6-b88a-8761174c1509" containerName="payload-processing" containerID="cri-o://e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb" gracePeriod=30
Jul 24 20:23:45.895408 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:45.895380    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"]
Jul 24 20:23:45.895651 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:45.895616    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc" podUID="cf620a1b-b10e-4155-9728-42cff8c8a3d0" containerName="payload-pre-processing" containerID="cri-o://b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7" gracePeriod=30
Jul 24 20:23:45.932365 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:45.932341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:46.033768 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.033722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:46.159486 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.159442    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:23:46.162187 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.162170    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:23:46.206503 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.206480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fe0321-695e-44f6-b88a-8761174c1509-plugins-config-volume\") pod \"e9fe0321-695e-44f6-b88a-8761174c1509\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") "
Jul 24 20:23:46.206631 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.206529    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c892\" (UniqueName: \"kubernetes.io/projected/e9fe0321-695e-44f6-b88a-8761174c1509-kube-api-access-5c892\") pod \"e9fe0321-695e-44f6-b88a-8761174c1509\" (UID: \"e9fe0321-695e-44f6-b88a-8761174c1509\") "
Jul 24 20:23:46.206631 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.206552    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5wbx\" (UniqueName: \"kubernetes.io/projected/cf620a1b-b10e-4155-9728-42cff8c8a3d0-kube-api-access-p5wbx\") pod \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") "
Jul 24 20:23:46.206631 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.206616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf620a1b-b10e-4155-9728-42cff8c8a3d0-plugins-config-volume\") pod \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\" (UID: \"cf620a1b-b10e-4155-9728-42cff8c8a3d0\") "
Jul 24 20:23:46.206964 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.206864    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9fe0321-695e-44f6-b88a-8761174c1509-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9fe0321-695e-44f6-b88a-8761174c1509" (UID: "e9fe0321-695e-44f6-b88a-8761174c1509"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:46.207085 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.207061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf620a1b-b10e-4155-9728-42cff8c8a3d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf620a1b-b10e-4155-9728-42cff8c8a3d0" (UID: "cf620a1b-b10e-4155-9728-42cff8c8a3d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 20:23:46.208571 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.208554    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9fe0321-695e-44f6-b88a-8761174c1509-kube-api-access-5c892" (OuterVolumeSpecName: "kube-api-access-5c892") pod "e9fe0321-695e-44f6-b88a-8761174c1509" (UID: "e9fe0321-695e-44f6-b88a-8761174c1509"). InnerVolumeSpecName "kube-api-access-5c892". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:46.208650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.208636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf620a1b-b10e-4155-9728-42cff8c8a3d0-kube-api-access-p5wbx" (OuterVolumeSpecName: "kube-api-access-p5wbx") pod "cf620a1b-b10e-4155-9728-42cff8c8a3d0" (UID: "cf620a1b-b10e-4155-9728-42cff8c8a3d0"). InnerVolumeSpecName "kube-api-access-p5wbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 20:23:46.307948 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.307927    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fe0321-695e-44f6-b88a-8761174c1509-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:46.307948 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.307948    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c892\" (UniqueName: \"kubernetes.io/projected/e9fe0321-695e-44f6-b88a-8761174c1509-kube-api-access-5c892\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:46.308094 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.307961    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5wbx\" (UniqueName: \"kubernetes.io/projected/cf620a1b-b10e-4155-9728-42cff8c8a3d0-kube-api-access-p5wbx\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:46.308094 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.307974    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf620a1b-b10e-4155-9728-42cff8c8a3d0-plugins-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\""
Jul 24 20:23:46.309438 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.309416    2560 generic.go:356] "Generic (PLEG): container finished" podID="cf620a1b-b10e-4155-9728-42cff8c8a3d0" containerID="b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7" exitCode=0
Jul 24 20:23:46.309554 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.309472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"
Jul 24 20:23:46.309554 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.309512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc" event={"ID":"cf620a1b-b10e-4155-9728-42cff8c8a3d0","Type":"ContainerDied","Data":"b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7"}
Jul 24 20:23:46.309672 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.309580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc" event={"ID":"cf620a1b-b10e-4155-9728-42cff8c8a3d0","Type":"ContainerDied","Data":"7b48f7eb587d45e4cf9030fafce100ef2f057aacef11fced84d72977832289cb"}
Jul 24 20:23:46.309672 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.309614    2560 scope.go:117] "RemoveContainer" containerID="b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7"
Jul 24 20:23:46.310789 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.310768    2560 generic.go:356] "Generic (PLEG): container finished" podID="e9fe0321-695e-44f6-b88a-8761174c1509" containerID="e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb" exitCode=0
Jul 24 20:23:46.310859 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.310806    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"
Jul 24 20:23:46.310859 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.310847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx" event={"ID":"e9fe0321-695e-44f6-b88a-8761174c1509","Type":"ContainerDied","Data":"e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb"}
Jul 24 20:23:46.310939 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.310886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx" event={"ID":"e9fe0321-695e-44f6-b88a-8761174c1509","Type":"ContainerDied","Data":"29f79405f16cfdee0ca925513753e1267b483d19d89ba7a21377305383bb91f4"}
Jul 24 20:23:46.319053 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.319030    2560 scope.go:117] "RemoveContainer" containerID="b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7"
Jul 24 20:23:46.319338 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:23:46.319319    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7\": container with ID starting with b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7 not found: ID does not exist" containerID="b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7"
Jul 24 20:23:46.319413 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.319344    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7"} err="failed to get container status \"b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7\": rpc error: code = NotFound desc = could not find container \"b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7\": container with ID starting with b541bb4e88285938fbb9132b12966a7e85ac68abbedbcca92cd13d992e84b8e7 not found: ID does not exist"
Jul 24 20:23:46.319413 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.319362    2560 scope.go:117] "RemoveContainer" containerID="e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb"
Jul 24 20:23:46.329954 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.329935    2560 scope.go:117] "RemoveContainer" containerID="e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb"
Jul 24 20:23:46.330209 ip-10-0-130-158 kubenswrapper[2560]: E0724 20:23:46.330184    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb\": container with ID starting with e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb not found: ID does not exist" containerID="e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb"
Jul 24 20:23:46.330254 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.330215    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb"} err="failed to get container status \"e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb\": rpc error: code = NotFound desc = could not find container \"e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb\": container with ID starting with e703516b89b7c0eb50a03415078c77cb4f2c791a2dfbaeda49a8e3a6358088cb not found: ID does not exist"
Jul 24 20:23:46.331850 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.331812    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"]
Jul 24 20:23:46.334046 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.334026    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3f5fc9-658f5b7bd8-flxsc"]
Jul 24 20:23:46.344590 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.344571    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"]
Jul 24 20:23:46.352371 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.350568    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3f5fc9-59f46fc86b-jcjgx"]
Jul 24 20:23:46.844270 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.844241    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf620a1b-b10e-4155-9728-42cff8c8a3d0" path="/var/lib/kubelet/pods/cf620a1b-b10e-4155-9728-42cff8c8a3d0/volumes"
Jul 24 20:23:46.844612 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:46.844598    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9fe0321-695e-44f6-b88a-8761174c1509" path="/var/lib/kubelet/pods/e9fe0321-695e-44f6-b88a-8761174c1509/volumes"
Jul 24 20:23:47.121969 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:47.121890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:49.104767 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:49.104728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-74jmj"]
Jul 24 20:23:50.332523 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:50.332473    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:50.333249 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:50.333220    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"]
Jul 24 20:23:50.335491 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:50.335466    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3f5fc9-mwmpx"]
Jul 24 20:23:50.699534 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:50.699503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:50.842817 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:50.842779    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="719cbfcb-3a96-46b6-aeb1-cd94bec96b20" path="/var/lib/kubelet/pods/719cbfcb-3a96-46b6-aeb1-cd94bec96b20/volumes"
Jul 24 20:23:56.376376 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:56.376343    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:56.477603 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:56.477571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:56.652241 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:56.652146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:23:56.868329 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:23:56.868293    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:24:03.368092 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:03.368066    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-cvgbd_1582e040-13e1-4387-885b-2c869ae21097/copy-manifests/0.log"
Jul 24 20:24:03.374124 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:03.374104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-cvgbd_1582e040-13e1-4387-885b-2c869ae21097/manager/0.log"
Jul 24 20:24:03.972709 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:03.972682    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748705-7zsws_db047630-33e2-4f1d-b74a-ed862deb54ca/cleanup/0.log"
Jul 24 20:24:05.887568 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:05.887536    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9wfrs_83feb7e3-7f2f-40d5-a1dc-a073049c2191/kuadrant-console-plugin/0.log"
Jul 24 20:24:06.243842 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:06.243816    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-74jmj_b9317eac-4398-4244-b3dd-3c3496ab5efb/limitador/0.log"
Jul 24 20:24:07.026730 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:07.026703    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c49bfc89-fbdkz_9ace8df7-6ceb-4ade-829b-12c2a701a54e/kube-auth-proxy/0.log"
Jul 24 20:24:07.388868 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:07.388791    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-84npd_4f2c48f6-1b66-440d-a848-5af660395855/payload-processing/0.log"
Jul 24 20:24:08.074286 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:08.074253    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wnsnd_3de2833f-b234-4eb1-89e2-24b10cc94eb4/main/0.log"
Jul 24 20:24:08.297879 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:08.297855    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wlfgg_7631bdcd-72ee-4c4e-af90-6840a9a20893/main/0.log"
Jul 24 20:24:11.041825 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:11.041749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:24:12.217048 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:12.217014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:24:13.982439 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:13.982403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:24:14.078788 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:14.078755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log" limit=1024
Jul 24 20:24:16.859259 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:16.859220    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j464j_67c3f51b-c2de-41c4-a2ff-0943d1e75372/global-pull-secret-syncer/0.log"
Jul 24 20:24:16.946752 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:16.946723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-htbcl_24cec716-6bc2-4ba8-b6c9-0d7ab89baff7/konnectivity-agent/0.log"
Jul 24 20:24:17.062202 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:17.062175    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-158.ec2.internal_0f041e38e0008b1154b43505cb789167/haproxy/0.log"
Jul 24 20:24:22.772636 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:22.772607    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9wfrs_83feb7e3-7f2f-40d5-a1dc-a073049c2191/kuadrant-console-plugin/0.log"
Jul 24 20:24:23.057787 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:23.057712    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-74jmj_b9317eac-4398-4244-b3dd-3c3496ab5efb/limitador/0.log"
Jul 24 20:24:24.879379 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:24.879302    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/alertmanager/0.log"
Jul 24 20:24:24.916818 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:24.916796    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/config-reloader/0.log"
Jul 24 20:24:24.938297 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:24.938280    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/kube-rbac-proxy-web/0.log"
Jul 24 20:24:24.960322 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:24.960297    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/kube-rbac-proxy/0.log"
Jul 24 20:24:24.981213 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:24.981191    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/kube-rbac-proxy-metric/0.log"
Jul 24 20:24:25.002438 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.002416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/prom-label-proxy/0.log"
Jul 24 20:24:25.023556 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.023532    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8083b225-26b4-4ae9-9682-afa8d06a2fc0/init-config-reloader/0.log"
Jul 24 20:24:25.127301 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.127282    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pfzrg_e474248e-bd1e-4fe1-8943-39498e0c2982/kube-state-metrics/0.log"
Jul 24 20:24:25.159176 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.159156    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pfzrg_e474248e-bd1e-4fe1-8943-39498e0c2982/kube-rbac-proxy-main/0.log"
Jul 24 20:24:25.195602 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.195584    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pfzrg_e474248e-bd1e-4fe1-8943-39498e0c2982/kube-rbac-proxy-self/0.log"
Jul 24 20:24:25.219983 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.219966    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68c798f594-nz527_c20ccd3c-7a3d-4eac-a588-d13ec5ab7256/metrics-server/0.log"
Jul 24 20:24:25.245330 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.245311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-5lw6n_5a99db37-0bf4-404d-a9a4-cbc0f06dcdd3/monitoring-plugin/0.log"
Jul 24 20:24:25.345576 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.345552    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czrv2_3b528eb1-3285-4a67-a437-a52327d06a26/node-exporter/0.log"
Jul 24 20:24:25.364526 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.364512    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czrv2_3b528eb1-3285-4a67-a437-a52327d06a26/kube-rbac-proxy/0.log"
Jul 24 20:24:25.385141 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.385123    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-czrv2_3b528eb1-3285-4a67-a437-a52327d06a26/init-textfile/0.log"
Jul 24 20:24:25.502872 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.502818    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-g4686_1f2b07d8-3625-4984-84bf-b2726da4844d/kube-rbac-proxy-main/0.log"
Jul 24 20:24:25.531856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.531835    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-g4686_1f2b07d8-3625-4984-84bf-b2726da4844d/kube-rbac-proxy-self/0.log"
Jul 24 20:24:25.552003 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.551985    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-g4686_1f2b07d8-3625-4984-84bf-b2726da4844d/openshift-state-metrics/0.log"
Jul 24 20:24:25.586303 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.586284    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/prometheus/0.log"
Jul 24 20:24:25.611637 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.611618    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/config-reloader/0.log"
Jul 24 20:24:25.638437 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.638420    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/thanos-sidecar/0.log"
Jul 24 20:24:25.657882 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.657866    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/kube-rbac-proxy-web/0.log"
Jul 24 20:24:25.682406 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.682388    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/kube-rbac-proxy/0.log"
Jul 24 20:24:25.705685 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.705666    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/kube-rbac-proxy-thanos/0.log"
Jul 24 20:24:25.724761 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.724744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a320ccac-9b98-4ab4-af64-46890a41ee7c/init-config-reloader/0.log"
Jul 24 20:24:25.749270 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.749253    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-n2h2g_36dc8bc8-20a3-4e77-bdb3-cbc2d540124b/prometheus-operator/0.log"
Jul 24 20:24:25.766630 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.766574    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-n2h2g_36dc8bc8-20a3-4e77-bdb3-cbc2d540124b/kube-rbac-proxy/0.log"
Jul 24 20:24:25.793427 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.793410    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-pqmq5_bda32a9a-eb45-4d36-9403-d16f79f5720d/prometheus-operator-admission-webhook/0.log"
Jul 24 20:24:25.908245 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.908225    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/thanos-query/0.log"
Jul 24 20:24:25.926760 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.926744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy-web/0.log"
Jul 24 20:24:25.946145 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.946129    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy/0.log"
Jul 24 20:24:25.965792 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.965775    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/prom-label-proxy/0.log"
Jul 24 20:24:25.988956 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:25.988936    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy-rules/0.log"
Jul 24 20:24:26.010338 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.010322    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54649cdbd7-xrbtq_0885cbf5-8ae3-424a-8a02-f5cf7cebb0a7/kube-rbac-proxy-metrics/0.log"
Jul 24 20:24:26.822045 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822010    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"]
Jul 24 20:24:26.822502 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822484    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9fe0321-695e-44f6-b88a-8761174c1509" containerName="payload-processing"
Jul 24 20:24:26.822502 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822503    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fe0321-695e-44f6-b88a-8761174c1509" containerName="payload-processing"
Jul 24 20:24:26.822655 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822532    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="719cbfcb-3a96-46b6-aeb1-cd94bec96b20" containerName="revoke-keys"
Jul 24 20:24:26.822655 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822541    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="719cbfcb-3a96-46b6-aeb1-cd94bec96b20" containerName="revoke-keys"
Jul 24 20:24:26.822655 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822556    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf620a1b-b10e-4155-9728-42cff8c8a3d0" containerName="payload-pre-processing"
Jul 24 20:24:26.822655 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822567    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf620a1b-b10e-4155-9728-42cff8c8a3d0" containerName="payload-pre-processing"
Jul 24 20:24:26.822856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822667    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="719cbfcb-3a96-46b6-aeb1-cd94bec96b20" containerName="revoke-keys"
Jul 24 20:24:26.822856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822680    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf620a1b-b10e-4155-9728-42cff8c8a3d0" containerName="payload-pre-processing"
Jul 24 20:24:26.822856 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.822695    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9fe0321-695e-44f6-b88a-8761174c1509" containerName="payload-processing"
Jul 24 20:24:26.825746 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.825721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:26.828337 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.828319    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzgtx\"/\"kube-root-ca.crt\""
Jul 24 20:24:26.829396 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.829377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gzgtx\"/\"default-dockercfg-q9hgm\""
Jul 24 20:24:26.829396 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.829385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzgtx\"/\"openshift-service-ca.crt\""
Jul 24 20:24:26.832984 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.832965    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"]
Jul 24 20:24:26.943475 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.943432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-sys\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:26.943815 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.943496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-podres\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:26.943815 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.943543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-lib-modules\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:26.943815 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.943560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsxv\" (UniqueName: \"kubernetes.io/projected/aa3db280-a951-4c87-b5cd-11c0237564ff-kube-api-access-tdsxv\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:26.943815 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:26.943589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-proc\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044418 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-proc\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-sys\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-podres\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-proc\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-lib-modules\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-sys\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsxv\" (UniqueName: \"kubernetes.io/projected/aa3db280-a951-4c87-b5cd-11c0237564ff-kube-api-access-tdsxv\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-podres\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.044650 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.044621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa3db280-a951-4c87-b5cd-11c0237564ff-lib-modules\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.051828 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.051810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsxv\" (UniqueName: \"kubernetes.io/projected/aa3db280-a951-4c87-b5cd-11c0237564ff-kube-api-access-tdsxv\") pod \"perf-node-gather-daemonset-lx767\" (UID: \"aa3db280-a951-4c87-b5cd-11c0237564ff\") " pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.136142 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.136074    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.265679 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.265650    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"]
Jul 24 20:24:27.269275 ip-10-0-130-158 kubenswrapper[2560]: W0724 20:24:27.269239    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa3db280_a951_4c87_b5cd_11c0237564ff.slice/crio-212158eefe99f6807cc69ee294045faeb87921c3b1cc257bd7ef7220ce6b6811 WatchSource:0}: Error finding container 212158eefe99f6807cc69ee294045faeb87921c3b1cc257bd7ef7220ce6b6811: Status 404 returned error can't find the container with id 212158eefe99f6807cc69ee294045faeb87921c3b1cc257bd7ef7220ce6b6811
Jul 24 20:24:27.527451 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.527420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767" event={"ID":"aa3db280-a951-4c87-b5cd-11c0237564ff","Type":"ContainerStarted","Data":"b724dfe7d6bbd9e5ecca2ece7b5325601a4cac9ae081cc89f357fd88af71e6ca"}
Jul 24 20:24:27.527598 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.527491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767" event={"ID":"aa3db280-a951-4c87-b5cd-11c0237564ff","Type":"ContainerStarted","Data":"212158eefe99f6807cc69ee294045faeb87921c3b1cc257bd7ef7220ce6b6811"}
Jul 24 20:24:27.527598 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.527522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:27.544200 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:27.544158    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767" podStartSLOduration=1.54414463 podStartE2EDuration="1.54414463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:24:27.541797071 +0000 UTC m=+2981.186060116" watchObservedRunningTime="2026-07-24 20:24:27.54414463 +0000 UTC m=+2981.188407669"
Jul 24 20:24:28.164706 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:28.164679    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f88d7b6b7-bl8zv_a6e29002-927e-4766-a975-b102a6ceb495/console/0.log"
Jul 24 20:24:29.791610 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:29.791569    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzjtp_21dc86dd-dad3-470b-a0ce-701f9fd264c2/dns/0.log"
Jul 24 20:24:29.813446 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:29.813379    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzjtp_21dc86dd-dad3-470b-a0ce-701f9fd264c2/kube-rbac-proxy/0.log"
Jul 24 20:24:29.928880 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:29.928798    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9km98_ed2c533d-fbe9-4774-92b8-433683baafb5/dns-node-resolver/0.log"
Jul 24 20:24:30.522978 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:30.522953    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f55bq_e329faa8-ddf2-4620-85d3-7288e5dcb8d2/node-ca/0.log"
Jul 24 20:24:31.655910 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:31.655883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c49bfc89-fbdkz_9ace8df7-6ceb-4ade-829b-12c2a701a54e/kube-auth-proxy/0.log"
Jul 24 20:24:31.776693 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:31.776670    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-84npd_4f2c48f6-1b66-440d-a848-5af660395855/payload-processing/0.log"
Jul 24 20:24:32.629911 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:32.629885    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nws7k_b2236125-f3ed-4308-b97f-0d34cbf2f348/serve-healthcheck-canary/0.log"
Jul 24 20:24:33.139442 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:33.139416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fs8zk_81b8c57a-d6d8-4819-8501-20501b859ff2/kube-rbac-proxy/0.log"
Jul 24 20:24:33.158420 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:33.158392    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fs8zk_81b8c57a-d6d8-4819-8501-20501b859ff2/exporter/0.log"
Jul 24 20:24:33.177079 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:33.177059    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fs8zk_81b8c57a-d6d8-4819-8501-20501b859ff2/extractor/0.log"
Jul 24 20:24:33.542577 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:33.542551    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gzgtx/perf-node-gather-daemonset-lx767"
Jul 24 20:24:36.376107 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:36.376084    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-cvgbd_1582e040-13e1-4387-885b-2c869ae21097/manager/0.log"
Jul 24 20:24:36.394280 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:36.394258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d7d8f86c4-cvgbd_1582e040-13e1-4387-885b-2c869ae21097/copy-manifests/0.log"
Jul 24 20:24:37.894280 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:37.894255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c7b4484d8-mgdw8_e5a8553e-8143-428c-b80b-18ed2dde25ac/manager/0.log"
Jul 24 20:24:37.945327 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:37.945272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8dt9k_7f6c2d88-f2da-466e-adf0-6b91080043ea/openshift-lws-operator/0.log"
Jul 24 20:24:38.097598 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:38.097570    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c49bfc89-fbdkz_9ace8df7-6ceb-4ade-829b-12c2a701a54e/kube-auth-proxy/0.log"
Jul 24 20:24:38.191890 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:38.191867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-84npd_4f2c48f6-1b66-440d-a848-5af660395855/payload-processing/0.log"
Jul 24 20:24:39.704011 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:39.703988    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c49bfc89-fbdkz_9ace8df7-6ceb-4ade-829b-12c2a701a54e/kube-auth-proxy/0.log"
Jul 24 20:24:39.803348 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:39.803324    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-84npd_4f2c48f6-1b66-440d-a848-5af660395855/payload-processing/0.log"
Jul 24 20:24:44.557938 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.557913    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/kube-multus-additional-cni-plugins/0.log"
Jul 24 20:24:44.576155 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.576131    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/egress-router-binary-copy/0.log"
Jul 24 20:24:44.597360 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.597337    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/cni-plugins/0.log"
Jul 24 20:24:44.621199 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.621181    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/bond-cni-plugin/0.log"
Jul 24 20:24:44.639795 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.639774    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/routeoverride-cni/0.log"
Jul 24 20:24:44.660089 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.660066    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/whereabouts-cni-bincopy/0.log"
Jul 24 20:24:44.678977 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.678957    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rfrf7_fc26931b-f9cb-4077-9c00-a41a3354a4e3/whereabouts-cni/0.log"
Jul 24 20:24:44.711799 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.711779    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dt7lg_d151e286-652c-404f-aa1d-f1fded98484a/kube-multus/0.log"
Jul 24 20:24:44.828165 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.828111    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d8vms_8ab1f5c3-d764-4742-8d9e-af785ea7e1d3/network-metrics-daemon/0.log"
Jul 24 20:24:44.845437 ip-10-0-130-158 kubenswrapper[2560]: I0724 20:24:44.845419    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d8vms_8ab1f5c3-d764-4742-8d9e-af785ea7e1d3/kube-rbac-proxy/0.log"