Jul 16 16:23:33.278903 ip-10-0-128-205 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 16:23:33.278914 ip-10-0-128-205 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 16:23:33.278923 ip-10-0-128-205 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 16:23:33.279269 ip-10-0-128-205 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 16:23:44.455486 ip-10-0-128-205 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 16:23:44.455508 ip-10-0-128-205 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7b70aecbd3a3435aa6c2aa8eec6bcf60 --
Jul 16 16:25:24.218753 ip-10-0-128-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 16:25:24.637136 ip-10-0-128-205 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 16:25:24.637136 ip-10-0-128-205 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 16:25:24.637136 ip-10-0-128-205 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 16:25:24.637136 ip-10-0-128-205 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 16:25:24.637136 ip-10-0-128-205 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 16:25:24.637897 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.637223    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 16:25:24.643516 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643499    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 16:25:24.643516 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643517    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643520    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643524    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643534    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643537    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643540    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643543    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643545    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643547    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643550    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643552    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643555    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643559    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643562    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643565    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643569    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643572    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643575    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643578    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 16:25:24.643604 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643580    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643583    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643603    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643606    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643609    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643611    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643614    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643617    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643620    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643623    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643625    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643628    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643630    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643633    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643635    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643638    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643640    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643643    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643647    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643649    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 16:25:24.644146 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643651    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643654    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643656    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643658    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643661    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643663    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643666    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643669    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643672    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643674    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643676    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643679    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643682    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643684    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643687    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643690    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643692    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643695    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643698    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643700    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 16:25:24.644658 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643704    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643706    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643709    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643711    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643713    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643716    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643718    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643720    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643723    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643725    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643728    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643732    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643734    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643738    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643740    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643742    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643745    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643747    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643751    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643753    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 16:25:24.645142 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643756    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643758    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643761    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643763    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643765    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643768    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643772    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643775    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643778    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643781    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643783    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643787    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643789    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643791    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643794    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643798    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643801    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643804    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 16:25:24.645620 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.643807    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 16:25:24.646195 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646182    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 16:25:24.646195 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646195    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646199    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646202    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646205    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646208    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646211    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646214    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646217    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646219    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646222    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646224    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646226    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646229    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646231    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646234    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646238    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646242    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646245    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646247    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 16:25:24.646243 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646250    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646253    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646256    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646258    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646260    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646263    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646265    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646267    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646270    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646272    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646275    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646277    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646279    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646281    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646284    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646286    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646288    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646290    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646293    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646297    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 16:25:24.646743 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646299    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646302    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646304    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646306    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646309    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646312    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646315    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646318    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646321    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646323    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646326    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646328    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646331    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646333    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646338    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646341    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646344    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646346    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646348    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 16:25:24.647229 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646351    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646353    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646355    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646358    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646360    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646363    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646365    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646368    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646370    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646373    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646375    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646378    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646381    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646383    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646385    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646388    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646390    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646392    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646395    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646398    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 16:25:24.647717 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646401    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646404    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646407    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646410    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646412    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646415    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646418    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646422    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646424    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646427    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646429    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646431    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646433    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646436    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646438    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646441    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646444    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646446    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646448    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646451    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 16:25:24.648194 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646838    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646842    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646846    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646849    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646851    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646854    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646857    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646861    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646865    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646868    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646871    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646873    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646875    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646878    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646880    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646883    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646885    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646888    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646891    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646894    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 16:25:24.648695 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646896    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646899    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646902    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646906    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646908    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646911    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646914    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646916    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646918    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646921    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646923    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646926    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646928    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646930    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646932    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646934    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646936    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646939    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646941    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 16:25:24.649168 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646944    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646946    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646948    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646950    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646953    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646955    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646957    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646959    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646962    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646964    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646969    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646971    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646974    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646976    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646979    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646981    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646983    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646986    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646988    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646990    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 16:25:24.649624 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646993    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646995    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.646997    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647000    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647002    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647004    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647007    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647009    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647013    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647015    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647017    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647020    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647022    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647024    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647027    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647029    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647032    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647034    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647037    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647039    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 16:25:24.650087 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647042    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647044    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647048    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647050    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647052    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647055    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647057    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647060    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647063    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647066    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647069    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647072    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647075    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647077    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647080    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647083    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647085    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647088    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647090    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 16:25:24.650594 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647092    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647161    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647169    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647178    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647185    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647192    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647198    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647204    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647209    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647212    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647215    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647218    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647222    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647224    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647227    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647232    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647235    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647238    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647241    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647246    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647248    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647251    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647254    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647258    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 16:25:24.651031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647261    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647264    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647267    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647270    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647273    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647275    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647278    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647281    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647285    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647289    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647292    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647294    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647297    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647300    2564 flags.go:64] FLAG: --enable-server="true"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647303    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647307    2564 flags.go:64] FLAG: --event-burst="100"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647310    2564 flags.go:64] FLAG: --event-qps="50"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647313    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647315    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647318    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647322    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647324    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647327    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647331    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647333    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 16:25:24.651690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647336    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647339    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647342    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647344    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647347    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647350    2564 flags.go:64] FLAG: --feature-gates=""
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647353    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647356    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647359    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647362    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647364    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647367    2564 flags.go:64] FLAG: --help="false"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647370    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-205.ec2.internal"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647372    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647375    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647379    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647382    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647385    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647387    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647390    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647392    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647395    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647398    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647401    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 16:25:24.652312 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647404    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647407    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647409    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647412    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647415    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647417    2564 flags.go:64] FLAG: --lock-file=""
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647420    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647423    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647426    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647431    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647434    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647436    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647439    2564 flags.go:64] FLAG: --logging-format="text"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647441    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647444    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647447    2564 flags.go:64] FLAG: --manifest-url=""
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647450    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647454    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647457    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647461    2564 flags.go:64] FLAG: --max-pods="110"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647463    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647466    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647469    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647473    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647476    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 16:25:24.652923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647492    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647496    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647503    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647506    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647508    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647511    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647515    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647520    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647523    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647533    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647536    2564 flags.go:64] FLAG: --port="10250"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647539    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647542    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a6063d4444a6ed1"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647545    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647547    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647550    2564 flags.go:64] FLAG: --register-node="true"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647553    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647556    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647559    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647561    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647582    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647601    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647604    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647607    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647610    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 16:25:24.653515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647613    2564 flags.go:64] FLAG: --runonce="false"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647615    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647618    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647621    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647624    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647628    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647631    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647634    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647637    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647640    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647643    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647645    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647648    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647651    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647655    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647657    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647662    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647665    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647668    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647672    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647675    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647678    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647680    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647683    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647686    2564 flags.go:64] FLAG: --v="2"
Jul 16 16:25:24.654103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647690    2564 flags.go:64] FLAG: --version="false"
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647693    2564 flags.go:64] FLAG: --vmodule=""
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647697    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.647700    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647814    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647817    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647820    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647823    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647826    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647829    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647832    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647835    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647840    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647842    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647845    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647847    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647851    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647854    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647857    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647863    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 16:25:24.654778 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647866    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647869    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647872    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647875    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647878    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647881    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647883    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647886    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647888    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647891    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647893    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647896    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647898    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647900    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647903    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647905    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647908    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647910    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647913    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 16:25:24.655276 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647915    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647918    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647920    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647922    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647925    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647929    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647931    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647933    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647936    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647938    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647941    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647943    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647947    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647950    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647953    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647955    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647958    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647960    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647963    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647965    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 16:25:24.655764 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647968    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647970    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647972    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647975    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647977    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647980    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647982    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647984    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647987    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647989    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647992    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647994    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647996    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.647999    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648001    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648003    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648006    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648010    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648012    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648014    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 16:25:24.656254 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648017    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648020    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648022    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648025    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648029    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648032    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648034    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648037    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648039    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648042    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648044    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648048    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648053    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648057    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648059    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648063    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648065    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648068    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648070    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 16:25:24.656752 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648073    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648075    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648078    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648080    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.648082    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.648940    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.655807    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.655827    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.656658    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.656667    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656735    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656740    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656744    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656747    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656749    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 16:25:24.657191 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656753    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656758    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656762    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656765    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656768    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656772    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656777    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656780    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656782    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656785    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656788    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656790    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656792    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656795    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656797    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656800    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656803    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656805    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656808    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656810    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 16:25:24.657583 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656813    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656815    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656818    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656835    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656841    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656844    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656847    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656850    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656853    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656856    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656858    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656861    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656864    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656866    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656869    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656871    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656874    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656876    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656880    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 16:25:24.658057 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656883    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656886    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656888    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656891    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656894    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656896    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656898    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656901    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656903    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656906    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656908    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656910    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656913    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656915    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656917    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656920    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656923    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656926    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656928    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656931    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 16:25:24.658652 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656933    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656936    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656938    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656941    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656943    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656945    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656947    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656950    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656952    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656954    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656957    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656959    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656961    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656963    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656966    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656968    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656970    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656973    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656975    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656977    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 16:25:24.659247 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656979    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656982    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656984    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656987    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656989    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656991    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656993    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656996    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.656999    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657001    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657003    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657006    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657009    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657011    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 16:25:24.659853 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657013    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.657018    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657127    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657131    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657134    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657136    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657139    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657141    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657144    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657147    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657149    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657154    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657156    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657159    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 16:25:24.660206 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657161    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657164    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657166    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657168    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657171    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657173    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657175    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657178    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657180    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657182    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657185    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657188    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657193    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657196    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657199    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657202    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657205    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657207    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657209    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 16:25:24.660606 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657212    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657214    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657216    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657219    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657222    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657226    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657228    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657231    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657234    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657236    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657239    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657241    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657244    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657246    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657249    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657251    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657254    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657256    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657258    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 16:25:24.661090 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657261    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657263    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657265    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657268    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657270    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657273    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657275    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657278    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657280    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657282    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657285    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657288    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657290    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657293    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657295    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657297    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657299    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657302    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657304    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 16:25:24.661565 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657306    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657308    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657311    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657313    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657315    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657318    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657320    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657322    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657325    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657327    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657329    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657332    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657334    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657337    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657340    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657342    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657344    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657347    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657349    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657351    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 16:25:24.662018 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657353    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657355    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657358    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657362    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657366    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657368    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657371    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657374    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:24.657376    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.657381    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.657503    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 16:25:24.662469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.661746    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 16:25:24.663401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.663388    2564 server.go:1019] "Starting client certificate rotation"
Jul 16 16:25:24.663595 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.663505    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 16:25:24.663595 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.663545    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 16:25:24.666396 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.666381    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 16:25:24.668829 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.668813    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 16:25:24.680661 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.680640    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 16 16:25:24.682871 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.682858    2564 log.go:25] "Validated CRI v1 image API"
Jul 16 16:25:24.684529 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.684516    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 16:25:24.688188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.688163    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ae84a07-1557-4e99-ba29-8373cee8c5ce:/dev/nvme0n1p3 c1f1a562-7515-491e-bb81-031f2c5f293b:/dev/nvme0n1p4]
Jul 16 16:25:24.688257 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.688187    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 16:25:24.693313 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.693199    2564 manager.go:216] Machine: {Timestamp:2026-07-16 16:25:24.691725193 +0000 UTC m=+0.351964587 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3217690 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d4916d4ffd3ecc4ecd78f5c016da SystemUUID:ec21d491-6d4f-fd3e-cc4e-cd78f5c016da BootID:7b70aecb-d3a3-435a-a6c2-aa8eec6bcf60 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:37:79:80:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:37:79:80:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:2c:b1:89:82:f8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 16:25:24.693313 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.693307    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 16:25:24.693430 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.693385    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 16:25:24.695104 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.695089    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 16:25:24.696064 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.696035    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 16:25:24.696203 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.696068    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 16:25:24.696833 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.696823    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 16:25:24.696867 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.696836    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 16:25:24.696867 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.696844    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 16:25:24.697621 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.697610    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 16:25:24.699352 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.699342    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 16:25:24.702645 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702634    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 16:25:24.702766 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702757    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 16:25:24.702799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702786    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 16:25:24.702799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702796    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 16:25:24.702847 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702810    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 16:25:24.702847 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702820    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 16 16:25:24.702847 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.702832    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 16:25:24.703277 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.703262    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 16:25:24.703334 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.703281    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 16:25:24.706169 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.706132    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 16:25:24.708580 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708567    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 16:25:24.708628 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708597    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 16:25:24.708772 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708763    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 16:25:24.708804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708777    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 16:25:24.708804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708784    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 16:25:24.708804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708790    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 16:25:24.708804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708798    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 16:25:24.708804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.708803    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 16:25:24.709474 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.709465    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 16:25:24.709520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.709474    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 16:25:24.709520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.709498    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 16:25:24.709520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.709504    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 16:25:24.709520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.709513    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 16:25:24.709520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.709520    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 16:25:24.710460 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.710451    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 16:25:24.710504 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.710460    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 16:25:24.713613 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.713598    2564 server.go:1268] "Started kubelet"
Jul 16 16:25:24.713718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.713689    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 16:25:24.713760 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.713698    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 16:25:24.713789 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.713772    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 16:25:24.714528 ip-10-0-128-205 systemd[1]: Started Kubernetes Kubelet.
Jul 16 16:25:24.715449 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.715354    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 16:25:24.715519 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.715455    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 16:25:24.715668 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.715498    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 16:25:24.715972 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.715957    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 16:25:24.716054 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.715993    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 16:25:24.717756 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.717738    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 16:25:24.721930 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.720828    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-205.ec2.internal.18c2d1d73a02cefa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-205.ec2.internal,UID:ip-10-0-128-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-205.ec2.internal,},FirstTimestamp:2026-07-16 16:25:24.713574138 +0000 UTC m=+0.373813532,LastTimestamp:2026-07-16 16:25:24.713574138 +0000 UTC m=+0.373813532,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-205.ec2.internal,}"
Jul 16 16:25:24.722910 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.722890    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 16:25:24.722910 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.722902    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 16:25:24.723069 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.722979    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:24.724587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.723602    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 16:25:24.724587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.723630    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 16:25:24.724587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.723646    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 16:25:24.724587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.723756    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 16:25:24.724587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.723766    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 16:25:24.725011 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.724703    2564 factory.go:55] Registering systemd factory
Jul 16 16:25:24.725011 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.724720    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 16 16:25:24.725215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.725115    2564 factory.go:153] Registering CRI-O factory
Jul 16 16:25:24.725215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.725124    2564 factory.go:223] Registration of the crio container factory successfully
Jul 16 16:25:24.725215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.725180    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 16:25:24.725215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.725198    2564 factory.go:103] Registering Raw factory
Jul 16 16:25:24.725215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.725208    2564 manager.go:1196] Started watching for new ooms in manager
Jul 16 16:25:24.725939 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.725925    2564 manager.go:349] Starting recovery of all containers
Jul 16 16:25:24.728716 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.728679    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 16:25:24.729064 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.729009    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 16:25:24.736948 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.736888    2564 manager.go:354] Recovery completed
Jul 16 16:25:24.740799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.740786    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.742739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.742711    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.742800 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.742757    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.742800 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.742767    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:24.743265 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743251    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 16:25:24.743265 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743257    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.743389 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743262    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 16:25:24.743389 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743294    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 16:25:24.743961 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743947    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.744027 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743977    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.744027 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.743992    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:24.744439 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.744427    2564 policy_none.go:49] "None policy: Start"
Jul 16 16:25:24.744497 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.744442    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 16:25:24.744497 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.744452    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 16:25:24.745275 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.745200    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-205.ec2.internal.18c2d1d73bbfd73b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-205.ec2.internal,UID:ip-10-0-128-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-205.ec2.internal,},FirstTimestamp:2026-07-16 16:25:24.742739771 +0000 UTC m=+0.402979164,LastTimestamp:2026-07-16 16:25:24.742739771 +0000 UTC m=+0.402979164,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-205.ec2.internal,}"
Jul 16 16:25:24.745602 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.745587    2564 policy_none.go:47] "Start"
Jul 16 16:25:24.745901 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.745885    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmq9s"
Jul 16 16:25:24.758423 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.758222    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-205.ec2.internal.18c2d1d73bc02e58  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-205.ec2.internal,UID:ip-10-0-128-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-205.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-205.ec2.internal,},FirstTimestamp:2026-07-16 16:25:24.742762072 +0000 UTC m=+0.403001466,LastTimestamp:2026-07-16 16:25:24.742762072 +0000 UTC m=+0.403001466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-205.ec2.internal,}"
Jul 16 16:25:24.760736 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.760661    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-205.ec2.internal.18c2d1d73bc051be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-205.ec2.internal,UID:ip-10-0-128-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-205.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-205.ec2.internal,},FirstTimestamp:2026-07-16 16:25:24.742771134 +0000 UTC m=+0.403010529,LastTimestamp:2026-07-16 16:25:24.742771134 +0000 UTC m=+0.403010529,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-205.ec2.internal,}"
Jul 16 16:25:24.766153 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.766135    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmq9s"
Jul 16 16:25:24.769186 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.769125    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-205.ec2.internal.18c2d1d73bbfd73b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-205.ec2.internal.18c2d1d73bbfd73b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-205.ec2.internal,UID:ip-10-0-128-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-205.ec2.internal,},FirstTimestamp:2026-07-16 16:25:24.742739771 +0000 UTC m=+0.402979164,LastTimestamp:2026-07-16 16:25:24.743961591 +0000 UTC m=+0.404200989,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-205.ec2.internal,}"
Jul 16 16:25:24.785091 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785074    2564 manager.go:337] "Starting Device Plugin manager"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.785108    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785122    2564 server.go:87] "Starting device plugin registration server"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785378    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785390    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785501    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785568    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.785575    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.786096    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 16:25:24.792997 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.786140    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:24.867236 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.867201    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 16:25:24.868563 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.868541    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 16:25:24.868699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.868585    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 16:25:24.868699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.868611    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 16:25:24.868699 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.868653    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 16:25:24.871017 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.870998    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 16:25:24.886016 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.885998    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.886913 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.886899    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.886984 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.886927    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.886984 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.886940    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:24.886984 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.886969    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-205.ec2.internal"
Jul 16 16:25:24.897598 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.897556    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-205.ec2.internal"
Jul 16 16:25:24.897598 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.897577    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-205.ec2.internal\": node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:24.924681 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:24.924657    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:24.969647 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.969609    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"]
Jul 16 16:25:24.969747 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.969690    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.970926 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.970900    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.971015 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.970938    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.971015 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.970955    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:24.972472 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.972457    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.972596 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.972579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:24.972644 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.972613    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.973167 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.973148    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.973242 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.973181    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.973242 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.973192    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:24.973755 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.973740    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.973829 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.973765    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.973829 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.973774    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:24.974302 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.974286    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:24.974340 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.974314    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:24.974937 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.974919    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:24.975009 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.974941    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:24.975009 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:24.974955    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:25.004170 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.004143    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-205.ec2.internal\" not found" node="ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.008597 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.008579    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-205.ec2.internal\" not found" node="ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.025009 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.024985    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.025103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.025069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b059be3ded29982045f543b5ab3d9a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"0b059be3ded29982045f543b5ab3d9a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.025103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.025089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b059be3ded29982045f543b5ab3d9a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"0b059be3ded29982045f543b5ab3d9a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.025182 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.025104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/442a3b85d0a0c01edd399042a59b86a3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-205.ec2.internal\" (UID: \"442a3b85d0a0c01edd399042a59b86a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.125194 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.125169    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.125286 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.125199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b059be3ded29982045f543b5ab3d9a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"0b059be3ded29982045f543b5ab3d9a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.125286 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.125248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0b059be3ded29982045f543b5ab3d9a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"0b059be3ded29982045f543b5ab3d9a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.125286 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.125275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b059be3ded29982045f543b5ab3d9a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"0b059be3ded29982045f543b5ab3d9a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.125373 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.125314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/442a3b85d0a0c01edd399042a59b86a3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-205.ec2.internal\" (UID: \"442a3b85d0a0c01edd399042a59b86a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.125373 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.125338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/442a3b85d0a0c01edd399042a59b86a3-config\") pod \"kube-apiserver-proxy-ip-10-0-128-205.ec2.internal\" (UID: \"442a3b85d0a0c01edd399042a59b86a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.125373 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.125359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b059be3ded29982045f543b5ab3d9a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"0b059be3ded29982045f543b5ab3d9a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.225903 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.225831    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.306075 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.306041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.312211 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.312193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:25.326947 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.326925    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.427436 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.427400    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.527962 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.527887    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.628531 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.628500    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.662662 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.662636    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 16:25:25.663124 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.662788    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 16:25:25.728600 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.728572    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.770257 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.770191    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 16:20:25 +0000 UTC" deadline="2028-01-27 01:01:33.913889993 +0000 UTC"
Jul 16 16:25:25.770257 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.770246    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13424h36m8.143648151s"
Jul 16 16:25:25.777758 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.777375    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 16:25:25.778614 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.778563    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 16:25:25.780065 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.780044    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 16:25:25.780169 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.780075    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 16:25:25.780169 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.780085    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 16 16:25:25.784175 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:25.784142    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b059be3ded29982045f543b5ab3d9a8.slice/crio-df633861c8f8cb3a206abbbf9411c76f6497bd2738aaf6123f6b05681d4f33f4 WatchSource:0}: Error finding container df633861c8f8cb3a206abbbf9411c76f6497bd2738aaf6123f6b05681d4f33f4: Status 404 returned error can't find the container with id df633861c8f8cb3a206abbbf9411c76f6497bd2738aaf6123f6b05681d4f33f4
Jul 16 16:25:25.784413 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:25.784395    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442a3b85d0a0c01edd399042a59b86a3.slice/crio-0fb22c15227fffa09b171aaa13b0acd33a124771cb95e205323c00f2b427c9c6 WatchSource:0}: Error finding container 0fb22c15227fffa09b171aaa13b0acd33a124771cb95e205323c00f2b427c9c6: Status 404 returned error can't find the container with id 0fb22c15227fffa09b171aaa13b0acd33a124771cb95e205323c00f2b427c9c6
Jul 16 16:25:25.788180 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.788162    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 16:25:25.828846 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.828815    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:25.872351 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.872302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" event={"ID":"0b059be3ded29982045f543b5ab3d9a8","Type":"ContainerStarted","Data":"df633861c8f8cb3a206abbbf9411c76f6497bd2738aaf6123f6b05681d4f33f4"}
Jul 16 16:25:25.873300 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:25.873279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal" event={"ID":"442a3b85d0a0c01edd399042a59b86a3","Type":"ContainerStarted","Data":"0fb22c15227fffa09b171aaa13b0acd33a124771cb95e205323c00f2b427c9c6"}
Jul 16 16:25:25.929681 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:25.929654    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:26.030120 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.030044    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:26.130579 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.130546    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 16 16:25:26.164522 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.164473    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 16:25:26.223684 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.223646    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:26.236310 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.236275    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 16:25:26.237455 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.237433    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 16 16:25:26.248908 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.248880    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 16:25:26.309133 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.309051    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 16:25:26.704660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.704624    2564 apiserver.go:52] "Watching apiserver"
Jul 16 16:25:26.712795 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.712767    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 16:25:26.713224 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.713185    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-ddrpt","openshift-dns/node-resolver-z7d6s","openshift-image-registry/node-ca-8gskh","openshift-multus/multus-additional-cni-plugins-65fs2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal","openshift-multus/multus-x8vkh","openshift-multus/network-metrics-daemon-x9mkx","openshift-network-diagnostics/network-check-target-sdrbr","openshift-network-operator/iptables-alerter-gwdkm","openshift-ovn-kubernetes/ovnkube-node-6mvcr","kube-system/global-pull-secret-syncer-xn5vd","kube-system/konnectivity-agent-hl8xp","kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"]
Jul 16 16:25:26.714848 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.714824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:26.714965 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.714912    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:26.716325 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.716304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:26.716429 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.716377    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:26.717865 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.717843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.719490 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.719466    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.720777 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.720702    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bgmcf\""
Jul 16 16:25:26.720899 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.720882    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.721264 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.721087    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.721264 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.721221    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 16:25:26.721390 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.721332    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.721887 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.721865    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tg6vv\""
Jul 16 16:25:26.721887 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.721886    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 16:25:26.722300 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.722253    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.722300 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.722288    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 16:25:26.722438 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.722337    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 16:25:26.722495 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.722439    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.722721 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.722704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.723089 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.723012    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-768cx\""
Jul 16 16:25:26.723515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.723499    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.723627 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.723586    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 16:25:26.723627 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.723604    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.724310 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.724239    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.724730 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.724713    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 16:25:26.725224 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.725208    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nzn5f\""
Jul 16 16:25:26.725700 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.725682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.726668 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.726635    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 16:25:26.726766 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.726684    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.727240 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.726931    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.727240 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.727032    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s2fd4\""
Jul 16 16:25:26.729818 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.729098    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 16:25:26.729818 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.729520    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.729818 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.729792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.730025 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.729900    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.730025 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.729961    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2zpt9\""
Jul 16 16:25:26.732733 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.732709    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.732839 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.732735    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xcll2\""
Jul 16 16:25:26.733041 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.733018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.733041 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.733033    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.734436 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-tuned\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.734567 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.734567 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:26.734567 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-os-release\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.734722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-cni-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.734722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-os-release\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.734722 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.734613    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:26.734722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56442082-9a16-46d2-83fc-e751a879f471-cni-binary-copy\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.734722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-cni-bin\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.734722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-run\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/019c710d-5993-4ff8-a706-793f1769945c-serviceca\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-kubernetes\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/021316f2-a81f-4583-a6b9-dc1bfeaa0831-tmp\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n97bq\" (UniqueName: \"kubernetes.io/projected/fe9291d1-941d-4e57-98b9-d38831e76cec-kube-api-access-n97bq\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-k8s-cni-cncf-io\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-netns\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-kubelet\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysctl-conf\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-systemd\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.734990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-lib-modules\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzxvt\" (UniqueName: \"kubernetes.io/projected/019c710d-5993-4ff8-a706-793f1769945c-kube-api-access-qzxvt\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.735032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-cnibin\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-socket-dir-parent\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe9291d1-941d-4e57-98b9-d38831e76cec-host-slash\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/019c710d-5993-4ff8-a706-793f1769945c-host\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cnibin\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cni-binary-copy\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-cni-multus\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56442082-9a16-46d2-83fc-e751a879f471-multus-daemon-config\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9ll\" (UniqueName: \"kubernetes.io/projected/56442082-9a16-46d2-83fc-e751a879f471-kube-api-access-df9ll\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysconfig\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysctl-d\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-sys\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-hostroot\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.735787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-var-lib-kubelet\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-host\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28r9r\" (UniqueName: \"kubernetes.io/projected/021316f2-a81f-4583-a6b9-dc1bfeaa0831-kube-api-access-28r9r\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwsz6\" (UniqueName: \"kubernetes.io/projected/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-kube-api-access-dwsz6\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-system-cni-dir\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xj4t\" (UniqueName: \"kubernetes.io/projected/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-kube-api-access-5xj4t\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-system-cni-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-multus-certs\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735593    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-etc-kubernetes\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-modprobe-d\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe9291d1-941d-4e57-98b9-d38831e76cec-iptables-alerter-script\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-conf-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.735851    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 16:25:26.736708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.736335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.737469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.737023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gpjqx\""
Jul 16 16:25:26.737469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.737050    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 16:25:26.737469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.737023    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 16:25:26.737469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.737353    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 16:25:26.737469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.737452    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 16:25:26.738781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.738761    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r4z2l\""
Jul 16 16:25:26.738882 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.738849    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 16:25:26.739267 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.739249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 16:25:26.739267 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.739249    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 16:25:26.762419 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.762398    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x9dsm"
Jul 16 16:25:26.775919 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.775896    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x9dsm"
Jul 16 16:25:26.824495 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.824447    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 16:25:26.836173 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovnkube-script-lib\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.836173 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836169    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-hostroot\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-var-lib-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-cni-bin\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836288    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-hostroot\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54252c07-45d8-4724-b24a-e8a535573b8b-konnectivity-ca\") pod \"konnectivity-agent-hl8xp\" (UID: \"54252c07-45d8-4724-b24a-e8a535573b8b\") " pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xj4t\" (UniqueName: \"kubernetes.io/projected/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-kube-api-access-5xj4t\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-multus-certs\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-etc-kubernetes\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe9291d1-941d-4e57-98b9-d38831e76cec-iptables-alerter-script\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-slash\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.836452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-multus-certs\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-run-netns\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-etc-kubernetes\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-conf-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-tuned\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-conf-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-cni-netd\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-os-release\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56442082-9a16-46d2-83fc-e751a879f471-cni-binary-copy\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-os-release\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837014 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.836815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-log-socket\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837088    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db641f93-d3ba-4314-8fc6-db0e3066abca-kubelet-config\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-socket-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe9291d1-941d-4e57-98b9-d38831e76cec-iptables-alerter-script\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb7zp\" (UniqueName: \"kubernetes.io/projected/991b009c-d810-4e0e-8ebd-02a0a2f97919-kube-api-access-fb7zp\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-systemd\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-netns\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-netns\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-kubelet\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56442082-9a16-46d2-83fc-e751a879f471-cni-binary-copy\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysctl-conf\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-systemd\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-kubelet\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-registration-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-node-log\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.837616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-systemd\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysctl-conf\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-cnibin\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-cnibin\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-socket-dir-parent\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe9291d1-941d-4e57-98b9-d38831e76cec-host-slash\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-socket-dir-parent\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe9291d1-941d-4e57-98b9-d38831e76cec-host-slash\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bc7f455-cf30-43d8-897c-eada57e25cba-hosts-file\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-ovn\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cnibin\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cni-binary-copy\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cnibin\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56442082-9a16-46d2-83fc-e751a879f471-multus-daemon-config\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysctl-d\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.838411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-sys\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28r9r\" (UniqueName: \"kubernetes.io/projected/021316f2-a81f-4583-a6b9-dc1bfeaa0831-kube-api-access-28r9r\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwsz6\" (UniqueName: \"kubernetes.io/projected/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-kube-api-access-dwsz6\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-kubelet\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.837972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysctl-d\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838252    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-sys\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56442082-9a16-46d2-83fc-e751a879f471-multus-daemon-config\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-cni-binary-copy\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/019c710d-5993-4ff8-a706-793f1769945c-serviceca\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-device-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc7f455-cf30-43d8-897c-eada57e25cba-tmp-dir\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-systemd-units\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovnkube-config\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovn-node-metrics-cert\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-system-cni-dir\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-system-cni-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-modprobe-d\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-system-cni-dir\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-sys-fs\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/019c710d-5993-4ff8-a706-793f1769945c-serviceca\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8bd5\" (UniqueName: \"kubernetes.io/projected/5bc7f455-cf30-43d8-897c-eada57e25cba-kube-api-access-d8bd5\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-etc-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n5k4\" (UniqueName: \"kubernetes.io/projected/b691da1b-8770-42a9-86a5-a0c5b89e1871-kube-api-access-9n5k4\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db641f93-d3ba-4314-8fc6-db0e3066abca-dbus\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-os-release\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-cni-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-cni-bin\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-run\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.838991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.839728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-system-cni-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-run\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-multus-cni-dir\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54252c07-45d8-4724-b24a-e8a535573b8b-agent-certs\") pod \"konnectivity-agent-hl8xp\" (UID: \"54252c07-45d8-4724-b24a-e8a535573b8b\") " pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-cni-bin\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-os-release\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-kubernetes\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/021316f2-a81f-4583-a6b9-dc1bfeaa0831-tmp\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n97bq\" (UniqueName: \"kubernetes.io/projected/fe9291d1-941d-4e57-98b9-d38831e76cec-kube-api-access-n97bq\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.839259    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-k8s-cni-cncf-io\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839323    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-run-k8s-cni-cncf-io\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.839343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:25:27.339316084 +0000 UTC m=+2.999555468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-modprobe-d\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-kubernetes\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-lib-modules\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzxvt\" (UniqueName: \"kubernetes.io/projected/019c710d-5993-4ff8-a706-793f1769945c-kube-api-access-qzxvt\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.840459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/019c710d-5993-4ff8-a706-793f1769945c-host\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-cni-multus\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df9ll\" (UniqueName: \"kubernetes.io/projected/56442082-9a16-46d2-83fc-e751a879f471-kube-api-access-df9ll\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysconfig\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-var-lib-kubelet\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-host\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.839848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-env-overrides\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.840026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56442082-9a16-46d2-83fc-e751a879f471-host-var-lib-cni-multus\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.840076    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/019c710d-5993-4ff8-a706-793f1769945c-host\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.840081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-lib-modules\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.840125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-sysconfig\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.840143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-var-lib-kubelet\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.840174    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/021316f2-a81f-4583-a6b9-dc1bfeaa0831-host\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.841756 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.841428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/021316f2-a81f-4583-a6b9-dc1bfeaa0831-etc-tuned\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.842090 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.842061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/021316f2-a81f-4583-a6b9-dc1bfeaa0831-tmp\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.847038 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.847015    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:26.847172 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.847041    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:26.847172 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.847055    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:26.847172 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.847112    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:25:27.347093947 +0000 UTC m=+3.007333359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:26.849260 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.849232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28r9r\" (UniqueName: \"kubernetes.io/projected/021316f2-a81f-4583-a6b9-dc1bfeaa0831-kube-api-access-28r9r\") pod \"tuned-ddrpt\" (UID: \"021316f2-a81f-4583-a6b9-dc1bfeaa0831\") " pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:26.849838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.849689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xj4t\" (UniqueName: \"kubernetes.io/projected/ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7-kube-api-access-5xj4t\") pod \"multus-additional-cni-plugins-65fs2\" (UID: \"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7\") " pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:26.850412 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.850374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwsz6\" (UniqueName: \"kubernetes.io/projected/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-kube-api-access-dwsz6\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:26.851330 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.851307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzxvt\" (UniqueName: \"kubernetes.io/projected/019c710d-5993-4ff8-a706-793f1769945c-kube-api-access-qzxvt\") pod \"node-ca-8gskh\" (UID: \"019c710d-5993-4ff8-a706-793f1769945c\") " pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:26.851807 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.851788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9ll\" (UniqueName: \"kubernetes.io/projected/56442082-9a16-46d2-83fc-e751a879f471-kube-api-access-df9ll\") pod \"multus-x8vkh\" (UID: \"56442082-9a16-46d2-83fc-e751a879f471\") " pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:26.852375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.852353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n97bq\" (UniqueName: \"kubernetes.io/projected/fe9291d1-941d-4e57-98b9-d38831e76cec-kube-api-access-n97bq\") pod \"iptables-alerter-gwdkm\" (UID: \"fe9291d1-941d-4e57-98b9-d38831e76cec\") " pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:26.852846 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.852826    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 16:25:26.941108 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941108 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovnkube-config\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovn-node-metrics-cert\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-sys-fs\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8bd5\" (UniqueName: \"kubernetes.io/projected/5bc7f455-cf30-43d8-897c-eada57e25cba-kube-api-access-d8bd5\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-etc-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n5k4\" (UniqueName: \"kubernetes.io/projected/b691da1b-8770-42a9-86a5-a0c5b89e1871-kube-api-access-9n5k4\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db641f93-d3ba-4314-8fc6-db0e3066abca-dbus\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.941375 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54252c07-45d8-4724-b24a-e8a535573b8b-agent-certs\") pod \"konnectivity-agent-hl8xp\" (UID: \"54252c07-45d8-4724-b24a-e8a535573b8b\") " pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-env-overrides\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovnkube-script-lib\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-var-lib-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-cni-bin\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54252c07-45d8-4724-b24a-e8a535573b8b-konnectivity-ca\") pod \"konnectivity-agent-hl8xp\" (UID: \"54252c07-45d8-4724-b24a-e8a535573b8b\") " pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-slash\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-run-netns\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-cni-netd\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-log-socket\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db641f93-d3ba-4314-8fc6-db0e3066abca-kubelet-config\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-socket-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.941837 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb7zp\" (UniqueName: \"kubernetes.io/projected/991b009c-d810-4e0e-8ebd-02a0a2f97919-kube-api-access-fb7zp\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-systemd\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-registration-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-node-log\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.941996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bc7f455-cf30-43d8-897c-eada57e25cba-hosts-file\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-ovn\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-kubelet\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-device-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovnkube-config\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc7f455-cf30-43d8-897c-eada57e25cba-tmp-dir\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-systemd-units\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-systemd-units\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc7f455-cf30-43d8-897c-eada57e25cba-tmp-dir\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.942510 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-etc-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-sys-fs\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db641f93-d3ba-4314-8fc6-db0e3066abca-dbus\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-cni-netd\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-slash\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.942902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db641f93-d3ba-4314-8fc6-db0e3066abca-kubelet-config\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-socket-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943057    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-run-netns\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-log-socket\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-systemd\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-run-ovn-kubernetes\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-registration-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-node-log\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovnkube-script-lib\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.943302    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54252c07-45d8-4724-b24a-e8a535573b8b-konnectivity-ca\") pod \"konnectivity-agent-hl8xp\" (UID: \"54252c07-45d8-4724-b24a-e8a535573b8b\") " pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:26.943374    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:25:27.443355066 +0000 UTC m=+3.103594467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-var-lib-openvswitch\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bc7f455-cf30-43d8-897c-eada57e25cba-hosts-file\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-cni-bin\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-run-ovn\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b691da1b-8770-42a9-86a5-a0c5b89e1871-host-kubelet\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.943722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/991b009c-d810-4e0e-8ebd-02a0a2f97919-device-dir\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:26.944333 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.943812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b691da1b-8770-42a9-86a5-a0c5b89e1871-env-overrides\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.946105 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.946077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b691da1b-8770-42a9-86a5-a0c5b89e1871-ovn-node-metrics-cert\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.946239 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.946196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54252c07-45d8-4724-b24a-e8a535573b8b-agent-certs\") pod \"konnectivity-agent-hl8xp\" (UID: \"54252c07-45d8-4724-b24a-e8a535573b8b\") " pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:26.950447 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.950419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8bd5\" (UniqueName: \"kubernetes.io/projected/5bc7f455-cf30-43d8-897c-eada57e25cba-kube-api-access-d8bd5\") pod \"node-resolver-z7d6s\" (UID: \"5bc7f455-cf30-43d8-897c-eada57e25cba\") " pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:26.951514 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.951487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n5k4\" (UniqueName: \"kubernetes.io/projected/b691da1b-8770-42a9-86a5-a0c5b89e1871-kube-api-access-9n5k4\") pod \"ovnkube-node-6mvcr\" (UID: \"b691da1b-8770-42a9-86a5-a0c5b89e1871\") " pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:26.955166 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:26.955103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb7zp\" (UniqueName: \"kubernetes.io/projected/991b009c-d810-4e0e-8ebd-02a0a2f97919-kube-api-access-fb7zp\") pod \"aws-ebs-csi-driver-node-rcp25\" (UID: \"991b009c-d810-4e0e-8ebd-02a0a2f97919\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:27.033258 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.033222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8gskh"
Jul 16 16:25:27.040479 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.040450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65fs2"
Jul 16 16:25:27.049597 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.049573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ddrpt"
Jul 16 16:25:27.055556 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.055533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8vkh"
Jul 16 16:25:27.062667 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.062643    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwdkm"
Jul 16 16:25:27.072532 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.072502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25"
Jul 16 16:25:27.077572 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.077545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z7d6s"
Jul 16 16:25:27.084523 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.084502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:27.090438 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.090418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:27.345722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.345648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:27.345860 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.345771    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:27.345860 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.345845    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:25:28.345828837 +0000 UTC m=+4.006068222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:27.446444 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.446400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:27.446643 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.446499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:27.446643 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.446612    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:27.446643 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.446629    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:27.446643 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.446636    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:27.446643 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.446648    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:27.446853 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.446700    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:25:28.446680572 +0000 UTC m=+4.106919977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:27.446853 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.446714    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:25:28.446708137 +0000 UTC m=+4.106947520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:27.721172 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.721101    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec415f1a_b460_4d21_b3d4_6f27e9eb4ab7.slice/crio-d8b0d7287bb4c867cd221186c2bfec66653c256271d03ec2595aad2fc4de555c WatchSource:0}: Error finding container d8b0d7287bb4c867cd221186c2bfec66653c256271d03ec2595aad2fc4de555c: Status 404 returned error can't find the container with id d8b0d7287bb4c867cd221186c2bfec66653c256271d03ec2595aad2fc4de555c
Jul 16 16:25:27.725109 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.723625    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021316f2_a81f_4583_a6b9_dc1bfeaa0831.slice/crio-29e3978c8e6eb0c0930b8f80c47cf7f1306b4ff41b185f8162a0aa0cc501f045 WatchSource:0}: Error finding container 29e3978c8e6eb0c0930b8f80c47cf7f1306b4ff41b185f8162a0aa0cc501f045: Status 404 returned error can't find the container with id 29e3978c8e6eb0c0930b8f80c47cf7f1306b4ff41b185f8162a0aa0cc501f045
Jul 16 16:25:27.725781 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.725547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc7f455_cf30_43d8_897c_eada57e25cba.slice/crio-3d1a86df885d9364f0f3b1d379e3e1d8926699f30ab8067a624192cc642623b0 WatchSource:0}: Error finding container 3d1a86df885d9364f0f3b1d379e3e1d8926699f30ab8067a624192cc642623b0: Status 404 returned error can't find the container with id 3d1a86df885d9364f0f3b1d379e3e1d8926699f30ab8067a624192cc642623b0
Jul 16 16:25:27.728346 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.728318    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54252c07_45d8_4724_b24a_e8a535573b8b.slice/crio-edb7a1e6c3b8cc9e72fddc8cb9c5f8a5c1dd63cb57a26eef3e4418aa57cd1254 WatchSource:0}: Error finding container edb7a1e6c3b8cc9e72fddc8cb9c5f8a5c1dd63cb57a26eef3e4418aa57cd1254: Status 404 returned error can't find the container with id edb7a1e6c3b8cc9e72fddc8cb9c5f8a5c1dd63cb57a26eef3e4418aa57cd1254
Jul 16 16:25:27.729484 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.729462    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991b009c_d810_4e0e_8ebd_02a0a2f97919.slice/crio-5ed80f0a2504a1403cc14173c1d42e529b35dcadbd727275cd6501cb8dab637b WatchSource:0}: Error finding container 5ed80f0a2504a1403cc14173c1d42e529b35dcadbd727275cd6501cb8dab637b: Status 404 returned error can't find the container with id 5ed80f0a2504a1403cc14173c1d42e529b35dcadbd727275cd6501cb8dab637b
Jul 16 16:25:27.730675 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.730425    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56442082_9a16_46d2_83fc_e751a879f471.slice/crio-73dc77aca048c387af79575891d160f126dbfb5c44938c9c0a3c0b07fab2f33f WatchSource:0}: Error finding container 73dc77aca048c387af79575891d160f126dbfb5c44938c9c0a3c0b07fab2f33f: Status 404 returned error can't find the container with id 73dc77aca048c387af79575891d160f126dbfb5c44938c9c0a3c0b07fab2f33f
Jul 16 16:25:27.731917 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.731890    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9291d1_941d_4e57_98b9_d38831e76cec.slice/crio-61436bae843b2b80a919e883bd1c9b36ff4d9481c7c1bb23ebd7f69f30d7abe7 WatchSource:0}: Error finding container 61436bae843b2b80a919e883bd1c9b36ff4d9481c7c1bb23ebd7f69f30d7abe7: Status 404 returned error can't find the container with id 61436bae843b2b80a919e883bd1c9b36ff4d9481c7c1bb23ebd7f69f30d7abe7
Jul 16 16:25:27.733433 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:25:27.732872    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb691da1b_8770_42a9_86a5_a0c5b89e1871.slice/crio-3e89e44db721bab3cc19f88b92725ab447d48766c75975f8a1ce8bd5a02d750f WatchSource:0}: Error finding container 3e89e44db721bab3cc19f88b92725ab447d48766c75975f8a1ce8bd5a02d750f: Status 404 returned error can't find the container with id 3e89e44db721bab3cc19f88b92725ab447d48766c75975f8a1ce8bd5a02d750f
Jul 16 16:25:27.778989 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.778581    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:20:27 +0000 UTC" deadline="2028-02-02 01:03:04.883875175 +0000 UTC"
Jul 16 16:25:27.779106 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.778991    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13568h37m37.104890701s"
Jul 16 16:25:27.869051 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.869022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:27.869174 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.869138    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:27.869231 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.869191    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:27.869307 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:27.869285    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:27.880339 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.880305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal" event={"ID":"442a3b85d0a0c01edd399042a59b86a3","Type":"ContainerStarted","Data":"430e91ac485b51c66db4e854f06dd6c73de05dbde6e24d9572ac69f58f8d70ad"}
Jul 16 16:25:27.881645 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.881619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8gskh" event={"ID":"019c710d-5993-4ff8-a706-793f1769945c","Type":"ContainerStarted","Data":"d21771d00cd9fdb3d003a3465c4b6357f55b28b70115eefd451a5192d095b42b"}
Jul 16 16:25:27.882824 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.882798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwdkm" event={"ID":"fe9291d1-941d-4e57-98b9-d38831e76cec","Type":"ContainerStarted","Data":"61436bae843b2b80a919e883bd1c9b36ff4d9481c7c1bb23ebd7f69f30d7abe7"}
Jul 16 16:25:27.884714 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.884664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7d6s" event={"ID":"5bc7f455-cf30-43d8-897c-eada57e25cba","Type":"ContainerStarted","Data":"3d1a86df885d9364f0f3b1d379e3e1d8926699f30ab8067a624192cc642623b0"}
Jul 16 16:25:27.885768 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.885745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hl8xp" event={"ID":"54252c07-45d8-4724-b24a-e8a535573b8b","Type":"ContainerStarted","Data":"edb7a1e6c3b8cc9e72fddc8cb9c5f8a5c1dd63cb57a26eef3e4418aa57cd1254"}
Jul 16 16:25:27.886825 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.886797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerStarted","Data":"d8b0d7287bb4c867cd221186c2bfec66653c256271d03ec2595aad2fc4de555c"}
Jul 16 16:25:27.887944 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.887924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"3e89e44db721bab3cc19f88b92725ab447d48766c75975f8a1ce8bd5a02d750f"}
Jul 16 16:25:27.890401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.890381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8vkh" event={"ID":"56442082-9a16-46d2-83fc-e751a879f471","Type":"ContainerStarted","Data":"73dc77aca048c387af79575891d160f126dbfb5c44938c9c0a3c0b07fab2f33f"}
Jul 16 16:25:27.893649 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.893627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25" event={"ID":"991b009c-d810-4e0e-8ebd-02a0a2f97919","Type":"ContainerStarted","Data":"5ed80f0a2504a1403cc14173c1d42e529b35dcadbd727275cd6501cb8dab637b"}
Jul 16 16:25:27.894707 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.894688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ddrpt" event={"ID":"021316f2-a81f-4583-a6b9-dc1bfeaa0831","Type":"ContainerStarted","Data":"29e3978c8e6eb0c0930b8f80c47cf7f1306b4ff41b185f8162a0aa0cc501f045"}
Jul 16 16:25:27.906272 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:27.906177    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal" podStartSLOduration=1.9061652759999999 podStartE2EDuration="1.906165276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:27.905950094 +0000 UTC m=+3.566189501" watchObservedRunningTime="2026-07-16 16:25:27.906165276 +0000 UTC m=+3.566404681"
Jul 16 16:25:28.355398 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.355302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:28.355611 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.355479    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:28.355611 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.355568    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:25:30.355548243 +0000 UTC m=+6.015787644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:28.456711 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.456669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:28.456894 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.456762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:28.456966 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.456920    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:28.456966 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.456941    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:28.456966 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.456955    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:28.457131 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.457019    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:25:30.456998596 +0000 UTC m=+6.117238001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:28.457632 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.457468    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:28.457632 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.457528    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:25:30.457509894 +0000 UTC m=+6.117749284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:28.779907 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.779822    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:20:27 +0000 UTC" deadline="2028-04-16 08:29:58.343958866 +0000 UTC"
Jul 16 16:25:28.779907 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.779874    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15352h4m29.564090321s"
Jul 16 16:25:28.871763 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.871726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:28.871980 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:28.871874    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:28.914268 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.914202    2564 generic.go:356] "Generic (PLEG): container finished" podID="0b059be3ded29982045f543b5ab3d9a8" containerID="c349394de986e746fd192f3e35b2daee8cacda8da49ae5ec8d28cfb1cfff8e10" exitCode=0
Jul 16 16:25:28.915356 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:28.915218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" event={"ID":"0b059be3ded29982045f543b5ab3d9a8","Type":"ContainerDied","Data":"c349394de986e746fd192f3e35b2daee8cacda8da49ae5ec8d28cfb1cfff8e10"}
Jul 16 16:25:29.869317 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:29.869282    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:29.869878 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:29.869441    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:29.869878 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:29.869863    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:29.870002 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:29.869965    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:29.942046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:29.941983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" event={"ID":"0b059be3ded29982045f543b5ab3d9a8","Type":"ContainerStarted","Data":"a241e377f2d6e4868c5c7914e53f75ac85d776911bb55e9b6139f3feaa7c8d7b"}
Jul 16 16:25:30.376459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:30.375609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:30.376459 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.375784    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:30.376459 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.375861    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:25:34.375838862 +0000 UTC m=+10.036078250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:30.476257 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:30.476217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:30.476458 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:30.476305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:30.476518 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.476479    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:30.476518 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.476505    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:30.476707 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.476536    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:30.476707 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.476605    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:25:34.476583074 +0000 UTC m=+10.136822464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:30.477087 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.477067    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:30.477180 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.477139    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:25:34.477110195 +0000 UTC m=+10.137349582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:30.869768 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:30.869737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:30.870270 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:30.869873    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:31.870114 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:31.869399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:31.870114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:31.869549    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:31.870114 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:31.869960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:31.870114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:31.870067    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:32.869606 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:32.869571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:32.869794 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:32.869680    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:33.869136 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:33.869104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:33.869623 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:33.869226    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:33.869623 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:33.869567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:33.869747 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:33.869643    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:34.410598 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:34.410559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:34.410799 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.410719    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:34.410799 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.410785    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:25:42.410766393 +0000 UTC m=+18.071005778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:34.511607 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:34.511568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:34.511765 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:34.511652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:34.511824 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.511788    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:34.511869 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.511849    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:25:42.511831408 +0000 UTC m=+18.172070793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:34.512260 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.512242    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:34.512331 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.512264    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:34.512331 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.512274    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:34.512331 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.512314    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:25:42.512298903 +0000 UTC m=+18.172538299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:34.870862 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:34.870822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:34.871319 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:34.870938    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:35.870110 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:35.870070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:35.870279 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:35.870207    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:35.870666 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:35.870641    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:35.870782 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:35.870748    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:36.872658 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:36.872050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:36.872658 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:36.872201    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:37.870284 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:37.869620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:37.870284 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:37.869757    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:37.870284 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:37.870136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:37.870284 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:37.870236    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:38.869369 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:38.869328    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:38.869776 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:38.869464    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:39.869210 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:39.869172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:39.869388 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:39.869304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:39.869388 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:39.869354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:39.869707 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:39.869455    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:40.868930 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:40.868891    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:40.869125 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:40.869023    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:41.869173 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:41.869136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:41.869676 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:41.869140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:41.869676 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:41.869249    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:41.869676 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:41.869370    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:42.472012 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:42.471972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:42.472213 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.472151    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:42.472260 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.472233    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:25:58.47221259 +0000 UTC m=+34.132451973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:42.572727 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:42.572694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:42.572887 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:42.572749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:42.572887 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.572853    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:42.572887 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.572874    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:42.573014 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.572899    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:42.573014 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.572908    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:25:58.572893859 +0000 UTC m=+34.233133241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:42.573014 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.572909    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:42.573014 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.572954    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:25:58.572943162 +0000 UTC m=+34.233182544 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:42.869576 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:42.869546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:42.870036 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:42.869679    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:43.869886 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:43.869840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:43.870338 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:43.869849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:43.870338 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:43.870025    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:43.870338 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:43.870039    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:44.870367 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:44.870325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:44.870837 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:44.870429    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:45.869555 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:45.869519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:45.869555 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:45.869545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:45.869777 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:45.869632    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:45.869777 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:45.869756    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:46.870521 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:46.869864    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:46.870521 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:46.870008    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:46.980359 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:46.980323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hl8xp" event={"ID":"54252c07-45d8-4724-b24a-e8a535573b8b","Type":"ContainerStarted","Data":"a9c00b8e3ced27912c9be2539f222ce6ad965e3303795b80e327a02a847b6850"}
Jul 16 16:25:46.983041 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:46.983010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerStarted","Data":"566bed42ebd6600b8820fa17cfe192f193932f58e4e20236dce67974791b585d"}
Jul 16 16:25:46.985028 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:46.985004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8vkh" event={"ID":"56442082-9a16-46d2-83fc-e751a879f471","Type":"ContainerStarted","Data":"ac3d91b20ef746c1b3d488b0de1c46c15013ac14c816e83271cbe7f4f1fa6844"}
Jul 16 16:25:46.987759 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:46.987733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ddrpt" event={"ID":"021316f2-a81f-4583-a6b9-dc1bfeaa0831","Type":"ContainerStarted","Data":"99457e79f742349b4275faafde3c383b062e05df3bd9074656981a41f7f18ce9"}
Jul 16 16:25:47.019944 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.019879    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" podStartSLOduration=21.019864244 podStartE2EDuration="21.019864244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:29.968350076 +0000 UTC m=+5.628589483" watchObservedRunningTime="2026-07-16 16:25:47.019864244 +0000 UTC m=+22.680103646"
Jul 16 16:25:47.020518 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.020446    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hl8xp" podStartSLOduration=2.961513051 podStartE2EDuration="22.020434166s" totalImagesPullingTime="19.058921115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:47.019182796 +0000 UTC m=+22.679422197" watchObservedRunningTime="2026-07-16 16:25:47.020434166 +0000 UTC m=+22.680673569"
Jul 16 16:25:47.155754 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.155439    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ddrpt" podStartSLOduration=3.0922055569999998 podStartE2EDuration="22.155397805s" totalImagesPullingTime="19.063192248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:47.155218181 +0000 UTC m=+22.815457602" watchObservedRunningTime="2026-07-16 16:25:47.155397805 +0000 UTC m=+22.815637209"
Jul 16 16:25:47.230544 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.230470    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x8vkh" podStartSLOduration=3.11541728 podStartE2EDuration="22.230453654s" totalImagesPullingTime="19.115036374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:47.230287696 +0000 UTC m=+22.890527098" watchObservedRunningTime="2026-07-16 16:25:47.230453654 +0000 UTC m=+22.890693057"
Jul 16 16:25:47.869449 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.869403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:47.869629 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.869426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:47.869629 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:47.869576    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:47.869702 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:47.869663    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:47.991153 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.991118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8gskh" event={"ID":"019c710d-5993-4ff8-a706-793f1769945c","Type":"ContainerStarted","Data":"97932f7ba87669bbfbb57167a8ac9658bd73d9fa775232adc767adf4430ebbec"}
Jul 16 16:25:47.992725 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.992687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwdkm" event={"ID":"fe9291d1-941d-4e57-98b9-d38831e76cec","Type":"ContainerStarted","Data":"a58e87a6e7ca8b8fc1c5e35c050f179b971a7d7a6c624b733caad9a0296db9e7"}
Jul 16 16:25:47.994119 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.994093    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z7d6s" event={"ID":"5bc7f455-cf30-43d8-897c-eada57e25cba","Type":"ContainerStarted","Data":"df9099e250352afd49a2ed97b88d2a4ad07e2a7814a0c556a5c54ea23fd9338d"}
Jul 16 16:25:47.995346 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.995328    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7" containerID="566bed42ebd6600b8820fa17cfe192f193932f58e4e20236dce67974791b585d" exitCode=0
Jul 16 16:25:47.995449 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.995403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerDied","Data":"566bed42ebd6600b8820fa17cfe192f193932f58e4e20236dce67974791b585d"}
Jul 16 16:25:47.998453 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.998431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"96a39c9efb25786078009c3f33a75170759341900c1264fc3da833803eb8f40f"}
Jul 16 16:25:47.998580 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.998524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"5800e553ef6f09a2cb3bb417847d6f4f51be11efbf50a58ecf105bdd86eb0dcb"}
Jul 16 16:25:47.998704 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.998579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"8151a027f2fc68e29e68502b5687c3ce99b301d195fbfaa527a93f3658b120ef"}
Jul 16 16:25:47.998704 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.998627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"dacc822b7cc47682d38e4aa60ad31722144cc920b0f36cc8128b2e6ebb53ad4e"}
Jul 16 16:25:47.998704 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.998663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"be96d72043d517a2b88937a9d02012d8b4c35330d3971579db0f75195533b85b"}
Jul 16 16:25:47.998831 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.998708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"3106e5cb1a3f3fc5a560979a046a042c15412d58a4bb195c2b79802476fc3665"}
Jul 16 16:25:47.999867 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:47.999845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25" event={"ID":"991b009c-d810-4e0e-8ebd-02a0a2f97919","Type":"ContainerStarted","Data":"4e26e34cd877a74c23f0d4f98a81df997cb35dfe7b949452eeae8ce5295dbf27"}
Jul 16 16:25:48.031539 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:48.031465    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8gskh" podStartSLOduration=3.9759679869999998 podStartE2EDuration="23.031449933s" totalImagesPullingTime="19.055481946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:48.031307324 +0000 UTC m=+23.691546728" watchObservedRunningTime="2026-07-16 16:25:48.031449933 +0000 UTC m=+23.691689335"
Jul 16 16:25:48.114694 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:48.114655    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwdkm" podStartSLOduration=4.056956409 podStartE2EDuration="23.114640101s" totalImagesPullingTime="19.057683692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:48.083405165 +0000 UTC m=+23.743644568" watchObservedRunningTime="2026-07-16 16:25:48.114640101 +0000 UTC m=+23.774879503"
Jul 16 16:25:48.115009 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:48.114990    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z7d6s" podStartSLOduration=4.047067075 podStartE2EDuration="23.11498536s" totalImagesPullingTime="19.067918285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:48.114573588 +0000 UTC m=+23.774812991" watchObservedRunningTime="2026-07-16 16:25:48.11498536 +0000 UTC m=+23.775224763"
Jul 16 16:25:48.731366 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:48.731327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:48.732096 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:48.732076    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:48.873086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:48.873054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:48.873266 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:48.873182    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:49.002126 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:49.001985    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:49.002573 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:49.002545    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hl8xp"
Jul 16 16:25:49.869472 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:49.869434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:49.869684 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:49.869607    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:49.869748 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:49.869732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:49.869878 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:49.869849    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:50.007992 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:50.007951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"ebf80cea0756b1ef769038cea8049576da1a138c59581226c0ad0df7e2fc7d79"}
Jul 16 16:25:50.485013 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:50.484976    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 16:25:50.797339 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:50.797226    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T16:25:50.485001353Z","UUID":"f1f3aa48-6430-4ae9-bcbc-3d5b536ebfd4","Handler":null,"Name":"","Endpoint":""}
Jul 16 16:25:50.799256 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:50.799234    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 16:25:50.799404 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:50.799272    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 16:25:50.872303 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:50.872272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:50.872476 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:50.872367    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:51.012172 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:51.012138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25" event={"ID":"991b009c-d810-4e0e-8ebd-02a0a2f97919","Type":"ContainerStarted","Data":"15e1bede19a69faa808c47d71cc5d4aba231005e3c47e22ffe4360f169fa471f"}
Jul 16 16:25:51.869832 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:51.869802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:51.869832 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:51.869838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:51.870040 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:51.869928    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:51.870090 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:51.870056    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:52.869599 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:52.869404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:52.870258 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:52.869677    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:53.020042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.019936    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7" containerID="02e128ecebc2ba9e0768fa68099e61b0449bfcbdfd311310a938874646be20c3" exitCode=0
Jul 16 16:25:53.020042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.020013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerDied","Data":"02e128ecebc2ba9e0768fa68099e61b0449bfcbdfd311310a938874646be20c3"}
Jul 16 16:25:53.024222 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.024194    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" event={"ID":"b691da1b-8770-42a9-86a5-a0c5b89e1871","Type":"ContainerStarted","Data":"3a1cf46c5eb7f04bde3d02badbef912db8e3127ea8a8bd26887a0ff8cb87d962"}
Jul 16 16:25:53.024515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.024448    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:53.041345 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.041325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:53.073401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.073355    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" podStartSLOduration=8.950256705 podStartE2EDuration="28.073340307s" totalImagesPullingTime="19.123083602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:53.072946537 +0000 UTC m=+28.733185941" watchObservedRunningTime="2026-07-16 16:25:53.073340307 +0000 UTC m=+28.733579711"
Jul 16 16:25:53.869304 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.869273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:53.869564 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:53.869398    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:53.869564 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:53.869508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:53.869889 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:53.869600    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:54.028969 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.028935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25" event={"ID":"991b009c-d810-4e0e-8ebd-02a0a2f97919","Type":"ContainerStarted","Data":"1b57382d5cad1e0a3f04f8743f57132aae3efd5e97531263d7e63b728d6e0dfb"}
Jul 16 16:25:54.029123 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.029065    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 16:25:54.029531 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.029514    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:54.046191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.046167    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:54.054884 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.054835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcp25" podStartSLOduration=4.153826186 podStartE2EDuration="29.054819873s" totalImagesPullingTime="24.900993687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:25:54.054197965 +0000 UTC m=+29.714437367" watchObservedRunningTime="2026-07-16 16:25:54.054819873 +0000 UTC m=+29.715059304"
Jul 16 16:25:54.292919 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.292886    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xn5vd"]
Jul 16 16:25:54.293133 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.293028    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:54.293206 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:54.293137    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:54.298067 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.298032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sdrbr"]
Jul 16 16:25:54.298267 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.298183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:54.298315 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:54.298278    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:54.300926 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.300889    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x9mkx"]
Jul 16 16:25:54.301019 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:54.300994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:54.301101 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:54.301081    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:55.033477 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.033440    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7" containerID="14af306ec93889d70755c3c15061aca14eaa1678506358f33ef48c73232bd454" exitCode=0
Jul 16 16:25:55.034053 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.033528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerDied","Data":"14af306ec93889d70755c3c15061aca14eaa1678506358f33ef48c73232bd454"}
Jul 16 16:25:55.034053 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.033685    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 16:25:55.869221 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.869183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:55.869404 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.869180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:55.869404 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:55.869303    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:55.869404 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.869319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:55.869602 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:55.869433    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:55.869602 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:55.869547    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:55.969555 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:55.969519    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:25:57.055708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:57.055668    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr" podUID="b691da1b-8770-42a9-86a5-a0c5b89e1871" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 16 16:25:57.869717 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:57.869686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:57.869955 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:57.869796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:57.869955 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:57.869804    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sdrbr" podUID="c052601e-a47f-4bf5-a562-bb47f9722962"
Jul 16 16:25:57.869955 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:57.869823    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:57.869955 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:57.869902    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xn5vd" podUID="db641f93-d3ba-4314-8fc6-db0e3066abca"
Jul 16 16:25:57.870187 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:57.869991    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x9mkx" podUID="bd9af275-2a58-46f4-80ed-5abfb09dc1cc"
Jul 16 16:25:58.488870 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:58.488829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:58.489348 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.488964    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:58.489348 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.489039    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs podName:bd9af275-2a58-46f4-80ed-5abfb09dc1cc nodeName:}" failed. No retries permitted until 2026-07-16 16:26:30.489018056 +0000 UTC m=+66.149257444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs") pod "network-metrics-daemon-x9mkx" (UID: "bd9af275-2a58-46f4-80ed-5abfb09dc1cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 16:25:58.589390 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:58.589353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:58.589544 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:58.589442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:58.589544 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.589511    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:58.589639 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.589578    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret podName:db641f93-d3ba-4314-8fc6-db0e3066abca nodeName:}" failed. No retries permitted until 2026-07-16 16:26:30.589564241 +0000 UTC m=+66.249803623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret") pod "global-pull-secret-syncer-xn5vd" (UID: "db641f93-d3ba-4314-8fc6-db0e3066abca") : object "kube-system"/"original-pull-secret" not registered
Jul 16 16:25:58.589639 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.589578    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 16:25:58.589639 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.589597    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 16:25:58.589639 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.589606    2564 projected.go:196] Error preparing data for projected volume kube-api-access-t7pvl for pod openshift-network-diagnostics/network-check-target-sdrbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:58.589824 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:25:58.589643    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl podName:c052601e-a47f-4bf5-a562-bb47f9722962 nodeName:}" failed. No retries permitted until 2026-07-16 16:26:30.589630901 +0000 UTC m=+66.249870283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7pvl" (UniqueName: "kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl") pod "network-check-target-sdrbr" (UID: "c052601e-a47f-4bf5-a562-bb47f9722962") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 16:25:59.044129 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.044096    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7" containerID="6a68fddbf8a453f90db39e4847e0dde36d24bd3672e7ee79d93d9965686f2498" exitCode=0
Jul 16 16:25:59.044317 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.044150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerDied","Data":"6a68fddbf8a453f90db39e4847e0dde36d24bd3672e7ee79d93d9965686f2498"}
Jul 16 16:25:59.684133 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.684099    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeReady"
Jul 16 16:25:59.684739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.684269    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 16:25:59.743347 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.743310    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-656668cdb6-bzm6x"]
Jul 16 16:25:59.745344 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.745325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.753387 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.753360    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 16:25:59.753572 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.753541    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bpvsj\""
Jul 16 16:25:59.754277 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.754254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 16:25:59.754576 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.754558    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 16:25:59.763893 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.763868    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 16:25:59.783814 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.783780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5w697"]
Jul 16 16:25:59.786079 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.785877    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xhhjh"]
Jul 16 16:25:59.786079 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.786017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:25:59.788785 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.788743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656668cdb6-bzm6x"]
Jul 16 16:25:59.788901 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.788868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:25:59.789229 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.789206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 16:25:59.789935 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.789592    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 16:25:59.789935 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.789713    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qw68r\""
Jul 16 16:25:59.789935 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.789835    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 16:25:59.791993 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.791814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 16:25:59.791993 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.791865    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 16:25:59.792273 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.792254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2tpfl\""
Jul 16 16:25:59.809326 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.809293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5w697"]
Jul 16 16:25:59.815447 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.815419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhhjh"]
Jul 16 16:25:59.868981 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.868948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:25:59.868981 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.868974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:25:59.868981 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.868952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:25:59.875356 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.875208    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 16:25:59.875356 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.875227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 16:25:59.875356 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.875233    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 16:25:59.875356 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.875249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 16:25:59.875356 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.875278    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npp5l\""
Jul 16 16:25:59.875747 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.875356    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjpd8\""
Jul 16 16:25:59.899690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cf012c3-6aa0-473b-b42d-b14731ec012f-ca-trust-extracted\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.899838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b184a6a-f5ca-4852-b699-c22eb47103d6-cert\") pod \"ingress-canary-5w697\" (UID: \"6b184a6a-f5ca-4852-b699-c22eb47103d6\") " pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:25:59.899838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlxqp\" (UniqueName: \"kubernetes.io/projected/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-kube-api-access-tlxqp\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:25:59.899838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.899838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4llf\" (UniqueName: \"kubernetes.io/projected/6b184a6a-f5ca-4852-b699-c22eb47103d6-kube-api-access-g4llf\") pod \"ingress-canary-5w697\" (UID: \"6b184a6a-f5ca-4852-b699-c22eb47103d6\") " pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:25:59.899838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-config-volume\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:25:59.900076 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-tmp-dir\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:25:59.900076 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-image-registry-private-configuration\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.900076 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.899975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-certificates\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.900076 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.900006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:25:59.900076 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.900056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whft\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-kube-api-access-6whft\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.900308 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.900115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-trusted-ca\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.900308 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.900142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-installation-pull-secrets\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.900308 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.900167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-bound-sa-token\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:25:59.921879 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:25:59.921849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:00.001023 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.000943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-tmp-dir\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.001023 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.000994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-image-registry-private-configuration\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001245 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-certificates\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001245 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.001245 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6whft\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-kube-api-access-6whft\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001245 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.001223    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 16:26:00.001447 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.001300    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls podName:4bdd8ed0-8e1d-451b-9f3b-06c864aac49d nodeName:}" failed. No retries permitted until 2026-07-16 16:26:00.501282309 +0000 UTC m=+36.161521712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls") pod "dns-default-xhhjh" (UID: "4bdd8ed0-8e1d-451b-9f3b-06c864aac49d") : secret "dns-default-metrics-tls" not found
Jul 16 16:26:00.001447 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-tmp-dir\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.001589 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-trusted-ca\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001589 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-installation-pull-secrets\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001692 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-bound-sa-token\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001692 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cf012c3-6aa0-473b-b42d-b14731ec012f-ca-trust-extracted\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b184a6a-f5ca-4852-b699-c22eb47103d6-cert\") pod \"ingress-canary-5w697\" (UID: \"6b184a6a-f5ca-4852-b699-c22eb47103d6\") " pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:26:00.001799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxqp\" (UniqueName: \"kubernetes.io/projected/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-kube-api-access-tlxqp\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.001799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-certificates\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.001799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4llf\" (UniqueName: \"kubernetes.io/projected/6b184a6a-f5ca-4852-b699-c22eb47103d6-kube-api-access-g4llf\") pod \"ingress-canary-5w697\" (UID: \"6b184a6a-f5ca-4852-b699-c22eb47103d6\") " pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:26:00.002021 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.001940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-config-volume\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.002101 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.002067    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 16:26:00.002101 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.002091    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656668cdb6-bzm6x: secret "image-registry-tls" not found
Jul 16 16:26:00.002101 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.002085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cf012c3-6aa0-473b-b42d-b14731ec012f-ca-trust-extracted\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.002257 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.002154    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls podName:0cf012c3-6aa0-473b-b42d-b14731ec012f nodeName:}" failed. No retries permitted until 2026-07-16 16:26:00.502136303 +0000 UTC m=+36.162375696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls") pod "image-registry-656668cdb6-bzm6x" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f") : secret "image-registry-tls" not found
Jul 16 16:26:00.002429 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.002408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-config-volume\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.002932 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.002909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-trusted-ca\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.006221 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.006199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-installation-pull-secrets\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.006459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.006223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b184a6a-f5ca-4852-b699-c22eb47103d6-cert\") pod \"ingress-canary-5w697\" (UID: \"6b184a6a-f5ca-4852-b699-c22eb47103d6\") " pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:26:00.006459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.006202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-image-registry-private-configuration\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.014811 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.014780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-bound-sa-token\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.015001 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.014978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whft\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-kube-api-access-6whft\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.015984 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.015960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4llf\" (UniqueName: \"kubernetes.io/projected/6b184a6a-f5ca-4852-b699-c22eb47103d6-kube-api-access-g4llf\") pod \"ingress-canary-5w697\" (UID: \"6b184a6a-f5ca-4852-b699-c22eb47103d6\") " pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:26:00.018149 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.018130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxqp\" (UniqueName: \"kubernetes.io/projected/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-kube-api-access-tlxqp\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.071806 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.071771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:00.099639 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.099599    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5w697"
Jul 16 16:26:00.255390 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.255130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5w697"]
Jul 16 16:26:00.260763 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:00.260722    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b184a6a_f5ca_4852_b699_c22eb47103d6.slice/crio-8346c4a788d0375c5573bcae55d45b6803af4a9f30c1a37f0e4ccba0492ee495 WatchSource:0}: Error finding container 8346c4a788d0375c5573bcae55d45b6803af4a9f30c1a37f0e4ccba0492ee495: Status 404 returned error can't find the container with id 8346c4a788d0375c5573bcae55d45b6803af4a9f30c1a37f0e4ccba0492ee495
Jul 16 16:26:00.279560 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.279530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:00.506185 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.506085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:00.506185 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:00.506144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:00.506388 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.506246    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 16:26:00.506388 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.506265    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656668cdb6-bzm6x: secret "image-registry-tls" not found
Jul 16 16:26:00.506388 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.506273    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 16:26:00.506388 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.506329    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls podName:0cf012c3-6aa0-473b-b42d-b14731ec012f nodeName:}" failed. No retries permitted until 2026-07-16 16:26:01.506312243 +0000 UTC m=+37.166551625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls") pod "image-registry-656668cdb6-bzm6x" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f") : secret "image-registry-tls" not found
Jul 16 16:26:00.506388 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:00.506343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls podName:4bdd8ed0-8e1d-451b-9f3b-06c864aac49d nodeName:}" failed. No retries permitted until 2026-07-16 16:26:01.506337431 +0000 UTC m=+37.166576813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls") pod "dns-default-xhhjh" (UID: "4bdd8ed0-8e1d-451b-9f3b-06c864aac49d") : secret "dns-default-metrics-tls" not found
Jul 16 16:26:01.051170 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:01.051127    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5w697" event={"ID":"6b184a6a-f5ca-4852-b699-c22eb47103d6","Type":"ContainerStarted","Data":"8346c4a788d0375c5573bcae55d45b6803af4a9f30c1a37f0e4ccba0492ee495"}
Jul 16 16:26:01.472250 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:01.472215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:01.515053 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:01.515013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:01.515303 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:01.515071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:01.515303 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:01.515184    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 16:26:01.515303 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:01.515233    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls podName:4bdd8ed0-8e1d-451b-9f3b-06c864aac49d nodeName:}" failed. No retries permitted until 2026-07-16 16:26:03.515217762 +0000 UTC m=+39.175457143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls") pod "dns-default-xhhjh" (UID: "4bdd8ed0-8e1d-451b-9f3b-06c864aac49d") : secret "dns-default-metrics-tls" not found
Jul 16 16:26:01.515630 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:01.515611    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 16:26:01.515630 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:01.515628    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656668cdb6-bzm6x: secret "image-registry-tls" not found
Jul 16 16:26:01.515777 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:01.515676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls podName:0cf012c3-6aa0-473b-b42d-b14731ec012f nodeName:}" failed. No retries permitted until 2026-07-16 16:26:03.515659689 +0000 UTC m=+39.175899075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls") pod "image-registry-656668cdb6-bzm6x" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f") : secret "image-registry-tls" not found
Jul 16 16:26:03.532607 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:03.532552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:03.533114 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:03.532645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:03.533114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:03.532738    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 16:26:03.533114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:03.532759    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 16:26:03.533114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:03.532761    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656668cdb6-bzm6x: secret "image-registry-tls" not found
Jul 16 16:26:03.533114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:03.532830    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls podName:4bdd8ed0-8e1d-451b-9f3b-06c864aac49d nodeName:}" failed. No retries permitted until 2026-07-16 16:26:07.532810304 +0000 UTC m=+43.193049692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls") pod "dns-default-xhhjh" (UID: "4bdd8ed0-8e1d-451b-9f3b-06c864aac49d") : secret "dns-default-metrics-tls" not found
Jul 16 16:26:03.533114 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:03.532849    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls podName:0cf012c3-6aa0-473b-b42d-b14731ec012f nodeName:}" failed. No retries permitted until 2026-07-16 16:26:07.532840027 +0000 UTC m=+43.193079416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls") pod "image-registry-656668cdb6-bzm6x" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f") : secret "image-registry-tls" not found
Jul 16 16:26:04.462927 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:04.462890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:04.560155 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:04.560075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:05.045762 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:05.045716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:05.063864 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:05.063836    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7" containerID="8c29d8f8fe60317fbcf1eb1343c953d86dd4be14784e3fa0b576adaf141cef21" exitCode=0
Jul 16 16:26:05.064031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:05.063906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerDied","Data":"8c29d8f8fe60317fbcf1eb1343c953d86dd4be14784e3fa0b576adaf141cef21"}
Jul 16 16:26:05.065453 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:05.065427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5w697" event={"ID":"6b184a6a-f5ca-4852-b699-c22eb47103d6","Type":"ContainerStarted","Data":"d33744e10860f79d291656343f69b24c796b4936ad7a9f144f4cfcefb44d4a87"}
Jul 16 16:26:05.117019 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:05.116961    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5w697" podStartSLOduration=2.107808052 podStartE2EDuration="6.116939425s" totalImagesPullingTime="4.009131373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:05.115327658 +0000 UTC m=+40.775567066" watchObservedRunningTime="2026-07-16 16:26:05.116939425 +0000 UTC m=+40.777178828"
Jul 16 16:26:05.147384 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:05.147355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:06.070764 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:06.070735    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7" containerID="40067a9528da6d77ed58cb1fcb4d90626fd7e2d0357b560ac59e1980f406d6a0" exitCode=0
Jul 16 16:26:06.071148 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:06.070832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerDied","Data":"40067a9528da6d77ed58cb1fcb4d90626fd7e2d0357b560ac59e1980f406d6a0"}
Jul 16 16:26:06.373838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:06.373780    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:06.491634 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:06.491600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:06.560770 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:06.560717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:07.079616 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.079582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65fs2" event={"ID":"ec415f1a-b460-4d21-b3d4-6f27e9eb4ab7","Type":"ContainerStarted","Data":"43e7ad6e120a9adcb9b104dee26f124eb405790e530c2842972738a455f7ea13"}
Jul 16 16:26:07.113415 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.113368    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-65fs2" podStartSLOduration=8.784906852 podStartE2EDuration="42.113353811s" totalImagesPullingTime="33.328446959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:07.111416622 +0000 UTC m=+42.771656024" watchObservedRunningTime="2026-07-16 16:26:07.113353811 +0000 UTC m=+42.773593215"
Jul 16 16:26:07.317730 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.317695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:07.439228 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.439202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:07.564738 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.564695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:07.564738 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.564745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:07.564943 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:07.564856    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 16:26:07.564943 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:07.564878    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656668cdb6-bzm6x: secret "image-registry-tls" not found
Jul 16 16:26:07.564943 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:07.564926    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls podName:0cf012c3-6aa0-473b-b42d-b14731ec012f nodeName:}" failed. No retries permitted until 2026-07-16 16:26:15.564912463 +0000 UTC m=+51.225151880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls") pod "image-registry-656668cdb6-bzm6x" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f") : secret "image-registry-tls" not found
Jul 16 16:26:07.565054 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:07.564858    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 16:26:07.565054 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:07.564996    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls podName:4bdd8ed0-8e1d-451b-9f3b-06c864aac49d nodeName:}" failed. No retries permitted until 2026-07-16 16:26:15.564981639 +0000 UTC m=+51.225221022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls") pod "dns-default-xhhjh" (UID: "4bdd8ed0-8e1d-451b-9f3b-06c864aac49d") : secret "dns-default-metrics-tls" not found
Jul 16 16:26:07.662257 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.662200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:07.858192 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:07.858095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:08.277504 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:08.277452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:11.060808 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.060774    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"]
Jul 16 16:26:11.095800 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.095768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:11.098341 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.098323    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"]
Jul 16 16:26:11.098425 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.098415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"
Jul 16 16:26:11.126690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.126444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zzpws\""
Jul 16 16:26:11.127057 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.127024    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 16:26:11.127191 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.127170    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 16:26:11.189787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.189733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq4dx\" (UniqueName: \"kubernetes.io/projected/4df98561-995e-4d2e-9411-991e6cb4103d-kube-api-access-qq4dx\") pod \"migrator-7f59b54f6c-xvfc8\" (UID: \"4df98561-995e-4d2e-9411-991e6cb4103d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"
Jul 16 16:26:11.291085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.291049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq4dx\" (UniqueName: \"kubernetes.io/projected/4df98561-995e-4d2e-9411-991e6cb4103d-kube-api-access-qq4dx\") pod \"migrator-7f59b54f6c-xvfc8\" (UID: \"4df98561-995e-4d2e-9411-991e6cb4103d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"
Jul 16 16:26:11.301988 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.301957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:11.310116 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.310088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq4dx\" (UniqueName: \"kubernetes.io/projected/4df98561-995e-4d2e-9411-991e6cb4103d-kube-api-access-qq4dx\") pod \"migrator-7f59b54f6c-xvfc8\" (UID: \"4df98561-995e-4d2e-9411-991e6cb4103d\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"
Jul 16 16:26:11.421412 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.421373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"
Jul 16 16:26:11.470587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.470553    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9bqqw"]
Jul 16 16:26:11.483547 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.483518    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.486612 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.486537    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jn64s\""
Jul 16 16:26:11.487174 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.486783    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 16:26:11.487174 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.486805    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 16:26:11.487174 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.487030    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 16:26:11.488610 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.488573    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 16:26:11.515511 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.515430    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9bqqw"]
Jul 16 16:26:11.564196 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.564158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:11.573783 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.573736    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8"]
Jul 16 16:26:11.578953 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:11.578927    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df98561_995e_4d2e_9411_991e6cb4103d.slice/crio-a51a29e64f99e90411a1681a7731ac533d754d23012a00271d6600768bff2a9f WatchSource:0}: Error finding container a51a29e64f99e90411a1681a7731ac533d754d23012a00271d6600768bff2a9f: Status 404 returned error can't find the container with id a51a29e64f99e90411a1681a7731ac533d754d23012a00271d6600768bff2a9f
Jul 16 16:26:11.593915 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.593888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.594044 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.593951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4ab4d56-2329-42cc-a6bc-410c032fd56e-data-volume\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.594044 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.594007    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4ab4d56-2329-42cc-a6bc-410c032fd56e-crio-socket\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.594112 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.594062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2ln\" (UniqueName: \"kubernetes.io/projected/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-api-access-mp2ln\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.594112 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.594100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.642773 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.642736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:11.694542 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4ab4d56-2329-42cc-a6bc-410c032fd56e-data-volume\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694542 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4ab4d56-2329-42cc-a6bc-410c032fd56e-crio-socket\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694702 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2ln\" (UniqueName: \"kubernetes.io/projected/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-api-access-mp2ln\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694702 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694702 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:11.694660    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 16:26:11.694843 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:11.694727    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:12.194709199 +0000 UTC m=+47.854948583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : configmap "kube-rbac-proxy" not found
Jul 16 16:26:11.694843 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4ab4d56-2329-42cc-a6bc-410c032fd56e-crio-socket\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694843 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694843 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.694769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4ab4d56-2329-42cc-a6bc-410c032fd56e-data-volume\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.694843 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:11.694833    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:11.695073 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:11.694914    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:12.194888957 +0000 UTC m=+47.855128353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:11.703961 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.703937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2ln\" (UniqueName: \"kubernetes.io/projected/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-api-access-mp2ln\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:11.977135 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:11.977052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:12.082294 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:12.082253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:12.092957 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:12.092931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8" event={"ID":"4df98561-995e-4d2e-9411-991e6cb4103d","Type":"ContainerStarted","Data":"a51a29e64f99e90411a1681a7731ac533d754d23012a00271d6600768bff2a9f"}
Jul 16 16:26:12.198382 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:12.198348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:12.198565 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:12.198400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:12.198565 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:12.198468    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 16:26:12.198565 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:12.198496    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:12.198565 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:12.198541    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:13.198526598 +0000 UTC m=+48.858765980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:12.198565 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:12.198553    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:13.198546349 +0000 UTC m=+48.858785730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : configmap "kube-rbac-proxy" not found
Jul 16 16:26:12.326094 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:12.326011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:12.496664 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:12.496610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:13.207439 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.207401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:13.207887 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.207539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:13.207887 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:13.207610    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 16:26:13.207887 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:13.207621    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:13.207887 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:13.207664    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:15.207649805 +0000 UTC m=+50.867889187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : configmap "kube-rbac-proxy" not found
Jul 16 16:26:13.207887 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:13.207687    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:15.207669698 +0000 UTC m=+50.867909083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:13.835297 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.835269    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-87q64"]
Jul 16 16:26:13.847026 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.846982    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:13.848137 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.848048    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-87q64"]
Jul 16 16:26:13.849860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.849841    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 16:26:13.851030 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.850789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2n9gx\""
Jul 16 16:26:13.851030 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.850839    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 16:26:13.851030 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.850938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 16:26:13.851030 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.850789    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 16:26:13.872431 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.872407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:13.973044 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:13.972993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:14.014549 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.014518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-signing-cabundle\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.014729 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.014581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-signing-key\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.014729 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.014644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5pv2\" (UniqueName: \"kubernetes.io/projected/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-kube-api-access-g5pv2\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.061466 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.061438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7d6s_5bc7f455-cf30-43d8-897c-eada57e25cba/dns-node-resolver/0.log"
Jul 16 16:26:14.100142 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.100108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8" event={"ID":"4df98561-995e-4d2e-9411-991e6cb4103d","Type":"ContainerStarted","Data":"7f72237b55bce8964c74cca9d5bcc5071b826f836dbd1ba336c18129301977e7"}
Jul 16 16:26:14.100289 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.100170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8" event={"ID":"4df98561-995e-4d2e-9411-991e6cb4103d","Type":"ContainerStarted","Data":"0591f2a2544245c5c81693fd0c3cf031968215b9f782c183770d9004fe42432e"}
Jul 16 16:26:14.115831 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.115802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-signing-key\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.115955 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.115836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5pv2\" (UniqueName: \"kubernetes.io/projected/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-kube-api-access-g5pv2\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.115955 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.115901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-signing-cabundle\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.116664 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.116559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-signing-cabundle\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.118002 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.117953    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xvfc8" podStartSLOduration=0.93059644 podStartE2EDuration="3.117939834s" totalImagesPullingTime="2.187343394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:14.117570346 +0000 UTC m=+49.777809764" watchObservedRunningTime="2026-07-16 16:26:14.117939834 +0000 UTC m=+49.778179236"
Jul 16 16:26:14.118578 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.118561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-signing-key\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.129389 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.129362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5pv2\" (UniqueName: \"kubernetes.io/projected/d7104af7-cd48-4d44-8b5b-cf9b410fabf3-kube-api-access-g5pv2\") pod \"service-ca-79f68b9f4f-87q64\" (UID: \"d7104af7-cd48-4d44-8b5b-cf9b410fabf3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.157298 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.157264    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-87q64"
Jul 16 16:26:14.219719 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.219279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:14.289195 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.289118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-87q64"]
Jul 16 16:26:14.292282 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:14.292247    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7104af7_cd48_4d44_8b5b_cf9b410fabf3.slice/crio-7feb8c962b8da568f77b6f428d77c707c70591b21cc36441a2d0912bd39d0849 WatchSource:0}: Error finding container 7feb8c962b8da568f77b6f428d77c707c70591b21cc36441a2d0912bd39d0849: Status 404 returned error can't find the container with id 7feb8c962b8da568f77b6f428d77c707c70591b21cc36441a2d0912bd39d0849
Jul 16 16:26:14.292282 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.292263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:14.394328 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.394275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:14.860708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:14.860677    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8gskh_019c710d-5993-4ff8-a706-793f1769945c/node-ca/0.log"
Jul 16 16:26:15.104794 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.104748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-87q64" event={"ID":"d7104af7-cd48-4d44-8b5b-cf9b410fabf3","Type":"ContainerStarted","Data":"7feb8c962b8da568f77b6f428d77c707c70591b21cc36441a2d0912bd39d0849"}
Jul 16 16:26:15.119272 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.119245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:15.226378 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.226337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:15.226759 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.226428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:15.226759 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.226538    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:15.226759 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.226604    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:19.226587731 +0000 UTC m=+54.886827112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:15.226918 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.226902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4ab4d56-2329-42cc-a6bc-410c032fd56e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:15.313864 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.313829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:15.422338 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.422248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:15.462091 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.462061    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5w697_6b184a6a-f5ca-4852-b699-c22eb47103d6/serve-healthcheck-canary/0.log"
Jul 16 16:26:15.630123 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.630085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:15.630289 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.630191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:15.630289 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.630233    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 16:26:15.630363 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.630290    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 16:26:15.630363 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.630301    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656668cdb6-bzm6x: secret "image-registry-tls" not found
Jul 16 16:26:15.630363 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.630292    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls podName:4bdd8ed0-8e1d-451b-9f3b-06c864aac49d nodeName:}" failed. No retries permitted until 2026-07-16 16:26:31.630276469 +0000 UTC m=+67.290515852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls") pod "dns-default-xhhjh" (UID: "4bdd8ed0-8e1d-451b-9f3b-06c864aac49d") : secret "dns-default-metrics-tls" not found
Jul 16 16:26:15.630363 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:15.630351    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls podName:0cf012c3-6aa0-473b-b42d-b14731ec012f nodeName:}" failed. No retries permitted until 2026-07-16 16:26:31.630334383 +0000 UTC m=+67.290573770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls") pod "image-registry-656668cdb6-bzm6x" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f") : secret "image-registry-tls" not found
Jul 16 16:26:15.873157 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:15.873125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xvfc8_4df98561-995e-4d2e-9411-991e6cb4103d/migrator/0.log"
Jul 16 16:26:16.062018 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:16.061967    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xvfc8_4df98561-995e-4d2e-9411-991e6cb4103d/graceful-termination/0.log"
Jul 16 16:26:16.615751 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:16.615714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:16.683996 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:16.683961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:17.111525 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:17.111474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-87q64" event={"ID":"d7104af7-cd48-4d44-8b5b-cf9b410fabf3","Type":"ContainerStarted","Data":"b879e4f6e9cd814e0ac5acf0738b4e61eaea335244d5a12933e3c7bfe2ca170c"}
Jul 16 16:26:17.136725 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:17.136603    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-87q64" podStartSLOduration=1.5881406729999998 podStartE2EDuration="4.136586488s" totalImagesPullingTime="2.548445815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:17.136414158 +0000 UTC m=+52.796653561" watchObservedRunningTime="2026-07-16 16:26:17.136586488 +0000 UTC m=+52.796825890"
Jul 16 16:26:18.849349 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:18.849315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:19.004887 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:19.004853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:19.123880 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:19.123837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:19.261041 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:19.261002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:19.261202 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:19.261160    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:19.261261 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:19.261230    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls podName:c4ab4d56-2329-42cc-a6bc-410c032fd56e nodeName:}" failed. No retries permitted until 2026-07-16 16:26:27.261213148 +0000 UTC m=+62.921452529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9bqqw" (UID: "c4ab4d56-2329-42cc-a6bc-410c032fd56e") : secret "insights-runtime-extractor-tls" not found
Jul 16 16:26:19.268262 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:19.268222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:21.168708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:21.168658    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:21.276270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:21.276233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:21.372940 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:21.372906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:21.828710 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:21.828680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:21.929065 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:21.929028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:22.029874 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:22.029842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:22.149975 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:22.149943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:22.655737 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:22.655703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:22.812283 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:22.812231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:23.342216 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:23.342184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:23.800800 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:23.800766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:23.993797 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:23.993754    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:24.167012 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:24.166970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:24.350540 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:24.350506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:24.891507 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:24.891460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:26.468227 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:26.468181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:26.622428 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:26.622381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:27.048255 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.048225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6mvcr"
Jul 16 16:26:27.327429 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.327343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:27.329816 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.329792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4ab4d56-2329-42cc-a6bc-410c032fd56e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9bqqw\" (UID: \"c4ab4d56-2329-42cc-a6bc-410c032fd56e\") " pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:27.398698 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.398659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:27.398698 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.398671    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jn64s\""
Jul 16 16:26:27.406542 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.406520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9bqqw"
Jul 16 16:26:27.543669 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.543640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9bqqw"]
Jul 16 16:26:27.547758 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:27.547732    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ab4d56_2329_42cc_a6bc_410c032fd56e.slice/crio-66621327ae2e1aa3739a591343aa89523b397617816f3f1d9ed7b04464eb832f WatchSource:0}: Error finding container 66621327ae2e1aa3739a591343aa89523b397617816f3f1d9ed7b04464eb832f: Status 404 returned error can't find the container with id 66621327ae2e1aa3739a591343aa89523b397617816f3f1d9ed7b04464eb832f
Jul 16 16:26:27.596620 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.596553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:27.758084 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.758047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:27.935883 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:27.935851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:28.142625 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:28.142587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bqqw" event={"ID":"c4ab4d56-2329-42cc-a6bc-410c032fd56e","Type":"ContainerStarted","Data":"66621327ae2e1aa3739a591343aa89523b397617816f3f1d9ed7b04464eb832f"}
Jul 16 16:26:28.197495 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:28.197387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:28.984117 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:28.984082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:29.197705 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:29.197660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:29.422741 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:29.422710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:29.620901 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:29.620867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:30.318753 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.318721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:30.416211 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.416165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:30.553614 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.553577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:26:30.556469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.556445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 16:26:30.567631 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.567604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd9af275-2a58-46f4-80ed-5abfb09dc1cc-metrics-certs\") pod \"network-metrics-daemon-x9mkx\" (UID: \"bd9af275-2a58-46f4-80ed-5abfb09dc1cc\") " pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:26:30.655041 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.655002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:26:30.655238 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.655129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:26:30.658788 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.658761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 16:26:30.658930 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.658766    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 16:26:30.667673 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.667645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db641f93-d3ba-4314-8fc6-db0e3066abca-original-pull-secret\") pod \"global-pull-secret-syncer-xn5vd\" (UID: \"db641f93-d3ba-4314-8fc6-db0e3066abca\") " pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:26:30.668363 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.668183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 16:26:30.678050 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.678030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7pvl\" (UniqueName: \"kubernetes.io/projected/c052601e-a47f-4bf5-a562-bb47f9722962-kube-api-access-t7pvl\") pod \"network-check-target-sdrbr\" (UID: \"c052601e-a47f-4bf5-a562-bb47f9722962\") " pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:26:30.784244 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.784214    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vjpd8\""
Jul 16 16:26:30.791599 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.791549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:26:30.791775 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.791616    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npp5l\""
Jul 16 16:26:30.793804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.793785    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xn5vd"
Jul 16 16:26:30.799109 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:30.799087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x9mkx"
Jul 16 16:26:31.661694 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.661652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:31.662068 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.661715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:31.664180 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.664160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"image-registry-656668cdb6-bzm6x\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") " pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:31.664253 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.664164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bdd8ed0-8e1d-451b-9f3b-06c864aac49d-metrics-tls\") pod \"dns-default-xhhjh\" (UID: \"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d\") " pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:31.861822 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.861793    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bpvsj\""
Jul 16 16:26:31.867196 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.867156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:31.907668 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.907642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2tpfl\""
Jul 16 16:26:31.914409 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:31.914341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:32.590553 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:32.590455    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xn5vd"]
Jul 16 16:26:32.595948 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:32.595902    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb641f93_d3ba_4314_8fc6_db0e3066abca.slice/crio-98b7d060416457615983d0ace6dec996327427f8fa0a6f6c487fbd5e98aa99b3 WatchSource:0}: Error finding container 98b7d060416457615983d0ace6dec996327427f8fa0a6f6c487fbd5e98aa99b3: Status 404 returned error can't find the container with id 98b7d060416457615983d0ace6dec996327427f8fa0a6f6c487fbd5e98aa99b3
Jul 16 16:26:32.627781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:32.627753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x9mkx"]
Jul 16 16:26:32.631947 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:32.631920    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9af275_2a58_46f4_80ed_5abfb09dc1cc.slice/crio-c5660cba62e6834e7a7874ebf59085ed9425a4436ff1eabb28580f0164dc35a3 WatchSource:0}: Error finding container c5660cba62e6834e7a7874ebf59085ed9425a4436ff1eabb28580f0164dc35a3: Status 404 returned error can't find the container with id c5660cba62e6834e7a7874ebf59085ed9425a4436ff1eabb28580f0164dc35a3
Jul 16 16:26:32.885537 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:32.885506    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc052601e_a47f_4bf5_a562_bb47f9722962.slice/crio-e33b384652df4efce03e81d92506f2716794c975f15074e7875890f705a9cac5 WatchSource:0}: Error finding container e33b384652df4efce03e81d92506f2716794c975f15074e7875890f705a9cac5: Status 404 returned error can't find the container with id e33b384652df4efce03e81d92506f2716794c975f15074e7875890f705a9cac5
Jul 16 16:26:32.886990 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:32.886960    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdd8ed0_8e1d_451b_9f3b_06c864aac49d.slice/crio-485b97f2364c051cedbb7873c2f77f2186f8d2f4e27784a48cb7f1c0919edef2 WatchSource:0}: Error finding container 485b97f2364c051cedbb7873c2f77f2186f8d2f4e27784a48cb7f1c0919edef2: Status 404 returned error can't find the container with id 485b97f2364c051cedbb7873c2f77f2186f8d2f4e27784a48cb7f1c0919edef2
Jul 16 16:26:32.887235 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:32.887164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhhjh"]
Jul 16 16:26:32.887828 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:32.887703    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf012c3_6aa0_473b_b42d_b14731ec012f.slice/crio-591c5f8cd103dcca21009dba1c1f2a83060181338ddbb3d87e8969d6546271a9 WatchSource:0}: Error finding container 591c5f8cd103dcca21009dba1c1f2a83060181338ddbb3d87e8969d6546271a9: Status 404 returned error can't find the container with id 591c5f8cd103dcca21009dba1c1f2a83060181338ddbb3d87e8969d6546271a9
Jul 16 16:26:32.888564 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:32.888543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sdrbr"]
Jul 16 16:26:32.889684 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:32.889617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656668cdb6-bzm6x"]
Jul 16 16:26:33.161625 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.161431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bqqw" event={"ID":"c4ab4d56-2329-42cc-a6bc-410c032fd56e","Type":"ContainerStarted","Data":"aa5dec97ed01890fd3e42a7c1fa77a7d2c7a95ca176f75731d0d3c5c7c2269e5"}
Jul 16 16:26:33.164930 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.164750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" event={"ID":"0cf012c3-6aa0-473b-b42d-b14731ec012f","Type":"ContainerStarted","Data":"d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092"}
Jul 16 16:26:33.164930 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.164801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" event={"ID":"0cf012c3-6aa0-473b-b42d-b14731ec012f","Type":"ContainerStarted","Data":"591c5f8cd103dcca21009dba1c1f2a83060181338ddbb3d87e8969d6546271a9"}
Jul 16 16:26:33.164930 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.164848    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:33.168384 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.168352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sdrbr" event={"ID":"c052601e-a47f-4bf5-a562-bb47f9722962","Type":"ContainerStarted","Data":"e33b384652df4efce03e81d92506f2716794c975f15074e7875890f705a9cac5"}
Jul 16 16:26:33.171950 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.171924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x9mkx" event={"ID":"bd9af275-2a58-46f4-80ed-5abfb09dc1cc","Type":"ContainerStarted","Data":"c5660cba62e6834e7a7874ebf59085ed9425a4436ff1eabb28580f0164dc35a3"}
Jul 16 16:26:33.179276 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.174533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xn5vd" event={"ID":"db641f93-d3ba-4314-8fc6-db0e3066abca","Type":"ContainerStarted","Data":"98b7d060416457615983d0ace6dec996327427f8fa0a6f6c487fbd5e98aa99b3"}
Jul 16 16:26:33.179276 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:33.179137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhhjh" event={"ID":"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d","Type":"ContainerStarted","Data":"485b97f2364c051cedbb7873c2f77f2186f8d2f4e27784a48cb7f1c0919edef2"}
Jul 16 16:26:34.189061 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:34.188976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x9mkx" event={"ID":"bd9af275-2a58-46f4-80ed-5abfb09dc1cc","Type":"ContainerStarted","Data":"10847bc6a5650288995c8b4a053f975fa4c79aaf0dc58233f35b194c8d9b4ef6"}
Jul 16 16:26:34.189531 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:34.189063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x9mkx" event={"ID":"bd9af275-2a58-46f4-80ed-5abfb09dc1cc","Type":"ContainerStarted","Data":"f8d295d5a16652c7d4a51c6d29befeef7c02e6a8cdf611fe6f535202c89ac172"}
Jul 16 16:26:34.229127 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:34.229059    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" podStartSLOduration=56.22903949 podStartE2EDuration="56.22903949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:33.2043916 +0000 UTC m=+68.864631005" watchObservedRunningTime="2026-07-16 16:26:34.22903949 +0000 UTC m=+69.889278897"
Jul 16 16:26:34.229512 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:34.229336    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x9mkx" podStartSLOduration=67.948568583 podStartE2EDuration="1m9.229293862s" totalImagesPullingTime="1.280725279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:34.228209179 +0000 UTC m=+69.888448583" watchObservedRunningTime="2026-07-16 16:26:34.229293862 +0000 UTC m=+69.889533266"
Jul 16 16:26:35.395771 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:35.395734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:35.500924 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:35.500883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:35.599366 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:35.599324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:37.143877 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.143844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:37.356112 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.356074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:37.365728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.365697    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"]
Jul 16 16:26:37.368681 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.368648    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.377973 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.377945    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 16:26:37.385213 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.385176    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"]
Jul 16 16:26:37.387503 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.385476    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 16:26:37.387503 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.385790    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 16:26:37.387503 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.386607    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 16:26:37.388044 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.388020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 16:26:37.388241 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.388228    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 16:26:37.389755 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.389738    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.393046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.393026    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 16:26:37.405752 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.405546    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 16:26:37.412460 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.412431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"]
Jul 16 16:26:37.413762 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.413741    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656668cdb6-bzm6x"]
Jul 16 16:26:37.414620 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.414599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-ca\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.414722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.414632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gld\" (UniqueName: \"kubernetes.io/projected/165f9aec-01fa-42f9-b7b7-39ad685c2d92-kube-api-access-n2gld\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.414722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.414666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.414836 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.414733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.414836 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.414762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/165f9aec-01fa-42f9-b7b7-39ad685c2d92-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.414836 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.414820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-hub\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.448885 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.448848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"]
Jul 16 16:26:37.515868 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.515824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4x8f\" (UniqueName: \"kubernetes.io/projected/00b0aaae-c710-4ba3-8203-29e157dc58c4-kube-api-access-r4x8f\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.516042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.515879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-hub\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.516042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.515926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-ca\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.516042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.515953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gld\" (UniqueName: \"kubernetes.io/projected/165f9aec-01fa-42f9-b7b7-39ad685c2d92-kube-api-access-n2gld\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.516042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.515992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.516042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.516012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b0aaae-c710-4ba3-8203-29e157dc58c4-tmp\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.516042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.516042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.516378 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.516067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/165f9aec-01fa-42f9-b7b7-39ad685c2d92-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.516378 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.516106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/00b0aaae-c710-4ba3-8203-29e157dc58c4-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.517036 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.517009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/165f9aec-01fa-42f9-b7b7-39ad685c2d92-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.519310 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.519283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.519707 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.519687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.519824 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.519808    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-hub\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.521604 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.521339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/165f9aec-01fa-42f9-b7b7-39ad685c2d92-ca\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.545804 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.545772    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ff8599596-4bmx8"]
Jul 16 16:26:37.549551 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.549520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.556186 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.556160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gld\" (UniqueName: \"kubernetes.io/projected/165f9aec-01fa-42f9-b7b7-39ad685c2d92-kube-api-access-n2gld\") pod \"cluster-proxy-proxy-agent-5587885d4d-rhj29\" (UID: \"165f9aec-01fa-42f9-b7b7-39ad685c2d92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.587773 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.587743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ff8599596-4bmx8"]
Jul 16 16:26:37.617274 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-bound-sa-token\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617423 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b0aaae-c710-4ba3-8203-29e157dc58c4-tmp\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.617423 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-registry-tls\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617423 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tsk\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-kube-api-access-94tsk\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617423 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/00b0aaae-c710-4ba3-8203-29e157dc58c4-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.617423 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4x8f\" (UniqueName: \"kubernetes.io/projected/00b0aaae-c710-4ba3-8203-29e157dc58c4-kube-api-access-r4x8f\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.617703 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/773c1781-6b26-40b1-858b-b1506f676bd3-trusted-ca\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617703 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/773c1781-6b26-40b1-858b-b1506f676bd3-installation-pull-secrets\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617703 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/773c1781-6b26-40b1-858b-b1506f676bd3-ca-trust-extracted\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617703 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/773c1781-6b26-40b1-858b-b1506f676bd3-registry-certificates\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617703 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/773c1781-6b26-40b1-858b-b1506f676bd3-image-registry-private-configuration\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.617911 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.617717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b0aaae-c710-4ba3-8203-29e157dc58c4-tmp\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.620265 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.620239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/00b0aaae-c710-4ba3-8203-29e157dc58c4-klusterlet-config\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.630027 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.630000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:37.642082 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.642051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4x8f\" (UniqueName: \"kubernetes.io/projected/00b0aaae-c710-4ba3-8203-29e157dc58c4-kube-api-access-r4x8f\") pod \"klusterlet-addon-workmgr-7cdbf99fb4-nkbtc\" (UID: \"00b0aaae-c710-4ba3-8203-29e157dc58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.690644 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.690575    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"
Jul 16 16:26:37.700622 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.700594    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:37.718130 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-bound-sa-token\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-registry-tls\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94tsk\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-kube-api-access-94tsk\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/773c1781-6b26-40b1-858b-b1506f676bd3-trusted-ca\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/773c1781-6b26-40b1-858b-b1506f676bd3-installation-pull-secrets\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/773c1781-6b26-40b1-858b-b1506f676bd3-ca-trust-extracted\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718535 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/773c1781-6b26-40b1-858b-b1506f676bd3-registry-certificates\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718535 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/773c1781-6b26-40b1-858b-b1506f676bd3-image-registry-private-configuration\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.718774 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.718726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/773c1781-6b26-40b1-858b-b1506f676bd3-ca-trust-extracted\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.719412 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.719360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/773c1781-6b26-40b1-858b-b1506f676bd3-registry-certificates\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.719547 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.719531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/773c1781-6b26-40b1-858b-b1506f676bd3-trusted-ca\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.721323 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.721299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/773c1781-6b26-40b1-858b-b1506f676bd3-image-registry-private-configuration\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.721398 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.721358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-registry-tls\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.721710 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.721678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/773c1781-6b26-40b1-858b-b1506f676bd3-installation-pull-secrets\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.731887 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.731854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tsk\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-kube-api-access-94tsk\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.736248 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.736227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/773c1781-6b26-40b1-858b-b1506f676bd3-bound-sa-token\") pod \"image-registry-6ff8599596-4bmx8\" (UID: \"773c1781-6b26-40b1-858b-b1506f676bd3\") " pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.770323 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.770274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:37.870244 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.870199    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:37.906978 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:37.906949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:38.121865 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:38.121834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:38.256140 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:38.256102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:38.828221 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:38.828191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:38.936952 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:38.936920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:40.405155 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:40.405120    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"]
Jul 16 16:26:40.424733 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:40.424626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ff8599596-4bmx8"]
Jul 16 16:26:40.431459 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:40.431435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29"]
Jul 16 16:26:40.432035 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:40.432004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773c1781_6b26_40b1_858b_b1506f676bd3.slice/crio-054cc624a12d566bc06342d6c1c453ec622823a338688c456891847a2ffde5d3 WatchSource:0}: Error finding container 054cc624a12d566bc06342d6c1c453ec622823a338688c456891847a2ffde5d3: Status 404 returned error can't find the container with id 054cc624a12d566bc06342d6c1c453ec622823a338688c456891847a2ffde5d3
Jul 16 16:26:40.435621 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:26:40.435594    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod165f9aec_01fa_42f9_b7b7_39ad685c2d92.slice/crio-3d72f7d4edf3a164efd737e4c6c3ddecd898e52cf66a290025c798ff3ab15adc WatchSource:0}: Error finding container 3d72f7d4edf3a164efd737e4c6c3ddecd898e52cf66a290025c798ff3ab15adc: Status 404 returned error can't find the container with id 3d72f7d4edf3a164efd737e4c6c3ddecd898e52cf66a290025c798ff3ab15adc
Jul 16 16:26:41.222687 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.222153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhhjh" event={"ID":"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d","Type":"ContainerStarted","Data":"68e8131ec2a92deff44fbc45c8244ebd0dfe032d1e99c1a33033b1f6333f0315"}
Jul 16 16:26:41.222687 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.222218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhhjh" event={"ID":"4bdd8ed0-8e1d-451b-9f3b-06c864aac49d","Type":"ContainerStarted","Data":"d3e554562ab6d7e7d623fff3b647b0e81a828f4b14341ddff5f185d2fe4561af"}
Jul 16 16:26:41.222687 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.222334    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:41.224530 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.224499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bqqw" event={"ID":"c4ab4d56-2329-42cc-a6bc-410c032fd56e","Type":"ContainerStarted","Data":"84309f9afd22ef9ff7a22354752bf2ae85633715dece80223e891bfebdae3a9d"}
Jul 16 16:26:41.226953 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.226928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sdrbr" event={"ID":"c052601e-a47f-4bf5-a562-bb47f9722962","Type":"ContainerStarted","Data":"65402bec098277f582ea1414625606ab5a7f0d05a9cbb537caeba43e44079fcf"}
Jul 16 16:26:41.227342 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.227327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:26:41.229332 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.229283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xn5vd" event={"ID":"db641f93-d3ba-4314-8fc6-db0e3066abca","Type":"ContainerStarted","Data":"9015b0c6d8cda25e65e9444649a05bc5f3f8a521f92815a1ad1def98173761f3"}
Jul 16 16:26:41.231745 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.231263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8" event={"ID":"773c1781-6b26-40b1-858b-b1506f676bd3","Type":"ContainerStarted","Data":"7306d2bde210bb733e63a34f572c04dd2f6b31fb0cf6ae89aac3802837baf942"}
Jul 16 16:26:41.231745 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.231299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8" event={"ID":"773c1781-6b26-40b1-858b-b1506f676bd3","Type":"ContainerStarted","Data":"054cc624a12d566bc06342d6c1c453ec622823a338688c456891847a2ffde5d3"}
Jul 16 16:26:41.231745 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.231700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:26:41.233105 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.233081    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc" event={"ID":"00b0aaae-c710-4ba3-8203-29e157dc58c4","Type":"ContainerStarted","Data":"fdc9516f8c447c54129ee7d60bc02ca51214eba51dfb6f8e615ec9e7dbc8af4c"}
Jul 16 16:26:41.234361 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.234337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29" event={"ID":"165f9aec-01fa-42f9-b7b7-39ad685c2d92","Type":"ContainerStarted","Data":"3d72f7d4edf3a164efd737e4c6c3ddecd898e52cf66a290025c798ff3ab15adc"}
Jul 16 16:26:41.275976 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.275905    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xn5vd" podStartSLOduration=68.70585891 podStartE2EDuration="1m16.275885127s" totalImagesPullingTime="7.570026217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:41.275071106 +0000 UTC m=+76.935310511" watchObservedRunningTime="2026-07-16 16:26:41.275885127 +0000 UTC m=+76.936124530"
Jul 16 16:26:41.276846 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.276588    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xhhjh" podStartSLOduration=36.072611917 podStartE2EDuration="42.276576584s" totalImagesPullingTime="6.203964667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:41.251080437 +0000 UTC m=+76.911319861" watchObservedRunningTime="2026-07-16 16:26:41.276576584 +0000 UTC m=+76.936815988"
Jul 16 16:26:41.339213 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.339077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8" podStartSLOduration=4.339057673 podStartE2EDuration="4.339057673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:41.338747602 +0000 UTC m=+76.998987004" watchObservedRunningTime="2026-07-16 16:26:41.339057673 +0000 UTC m=+76.999297073"
Jul 16 16:26:41.339999 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.339961    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sdrbr" podStartSLOduration=69.043797516 podStartE2EDuration="1m16.339950599s" totalImagesPullingTime="7.296153083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:41.29844797 +0000 UTC m=+76.958687377" watchObservedRunningTime="2026-07-16 16:26:41.339950599 +0000 UTC m=+77.000190003"
Jul 16 16:26:41.828620 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:41.828580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:42.020043 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:42.019960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:42.314101 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:42.314043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:42.507895 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:42.507829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:42.612311 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:42.612209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:42.725934 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:42.725880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:42.914874 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:42.914836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:43.383422 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:43.383386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:43.448640 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:43.448602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:43.679562 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:43.679465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:43.741558 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:43.741515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:47.266202 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.266161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9bqqw" event={"ID":"c4ab4d56-2329-42cc-a6bc-410c032fd56e","Type":"ContainerStarted","Data":"f9c1fe96dfe8167af6feee8915ab1782bc972c4c51a885900e6e20993806d240"}
Jul 16 16:26:47.267952 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.267918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc" event={"ID":"00b0aaae-c710-4ba3-8203-29e157dc58c4","Type":"ContainerStarted","Data":"95968c7de34496d05c5028a719656f8a08c2f0d4098cfd5346d37eec9ca2bae4"}
Jul 16 16:26:47.268129 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.268114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:47.270280 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.270256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc"
Jul 16 16:26:47.305203 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.305152    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9bqqw" podStartSLOduration=17.593593679 podStartE2EDuration="36.305138587s" totalImagesPullingTime="18.711544908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:26:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:47.304783556 +0000 UTC m=+82.965022959" watchObservedRunningTime="2026-07-16 16:26:47.305138587 +0000 UTC m=+82.965378034"
Jul 16 16:26:47.346218 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.346165    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7cdbf99fb4-nkbtc" podStartSLOduration=4.238003567 podStartE2EDuration="10.34614931s" totalImagesPullingTime="6.108145743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:26:47.345854192 +0000 UTC m=+83.006093621" watchObservedRunningTime="2026-07-16 16:26:47.34614931 +0000 UTC m=+83.006388692"
Jul 16 16:26:47.420232 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.420196    2564 patch_prober.go:28] interesting pod/image-registry-656668cdb6-bzm6x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 16:26:47.420418 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:47.420256    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" podUID="0cf012c3-6aa0-473b-b42d-b14731ec012f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 16:26:49.050041 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:49.050002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:49.132632 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:49.132601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:49.476082 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:49.476048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:50.563897 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:50.563863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:50.629017 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:50.628983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:51.248823 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:51.248793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xhhjh"
Jul 16 16:26:52.515797 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:52.515768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:52.577766 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:52.577736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:55.422747 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:55.422714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:55.543611 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:55.543579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:55.756549 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:55.756440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:55.856610 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:55.856577    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:55.926880 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:55.926830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:57.314067 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:57.314027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:57.418317 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:57.418289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:26:57.574588 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:57.574513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:57.674535 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:57.674503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:57.874151 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:57.874123    2564 patch_prober.go:28] interesting pod/image-registry-6ff8599596-4bmx8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 16:26:57.874309 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:57.874169    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8" podUID="773c1781-6b26-40b1-858b-b1506f676bd3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 16:26:59.230094 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.230059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:59.457303 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.457268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:59.535680 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.535598    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sg22d"]
Jul 16 16:26:59.540304 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.540279    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.544704 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.544681    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 16:26:59.544899 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.544877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kngrv\""
Jul 16 16:26:59.545164 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.545142    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 16:26:59.545279 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.545180    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 16:26:59.545750 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.545733    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 16:26:59.545750 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.545745    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 16:26:59.551721 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.551699    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 16:26:59.587124 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.587092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:59.686537 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.686478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:59.700922 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.700884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-wtmp\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.700933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-textfile\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.700970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6kw\" (UniqueName: \"kubernetes.io/projected/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-kube-api-access-kk6kw\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.701033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.701069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.701099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-root\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.701122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-sys\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.701165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-tls\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.701329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.701226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-metrics-client-ca\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.786909 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.786801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:59.801857 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.801825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-metrics-client-ca\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.801969 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.801862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-wtmp\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.801969 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.801878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-textfile\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.801969 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.801943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6kw\" (UniqueName: \"kubernetes.io/projected/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-kube-api-access-kk6kw\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802125 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.801985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802125 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802125 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-root\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802125 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-wtmp\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802125 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-sys\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802362 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802126    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-root\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802362 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-tls\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802362 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-sys\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802362 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:59.802314    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 16:26:59.802582 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:26:59.802404    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-tls podName:e1d8b8e4-7bb7-4674-9059-e722ca5f32cf nodeName:}" failed. No retries permitted until 2026-07-16 16:27:00.302382761 +0000 UTC m=+95.962622158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-tls") pod "node-exporter-sg22d" (UID: "e1d8b8e4-7bb7-4674-9059-e722ca5f32cf") : secret "node-exporter-tls" not found
Jul 16 16:26:59.802649 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802616    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-textfile\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802916 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.802966 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.802931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-metrics-client-ca\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.804567 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.804538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.813153 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.813126    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6kw\" (UniqueName: \"kubernetes.io/projected/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-kube-api-access-kk6kw\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:26:59.891389 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.891354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:26:59.967965 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:26:59.967931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:00.035705 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:00.035672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:00.306029 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:00.305990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-tls\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:27:00.308448 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:00.308418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1d8b8e4-7bb7-4674-9059-e722ca5f32cf-node-exporter-tls\") pod \"node-exporter-sg22d\" (UID: \"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf\") " pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:27:00.452889 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:00.452852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sg22d"
Jul 16 16:27:00.465106 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:27:00.465079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d8b8e4_7bb7_4674_9059_e722ca5f32cf.slice/crio-a5f8085387fffcd85669154a7bda456b8b833d67ac30621e6671970cb7574dd9 WatchSource:0}: Error finding container a5f8085387fffcd85669154a7bda456b8b833d67ac30621e6671970cb7574dd9: Status 404 returned error can't find the container with id a5f8085387fffcd85669154a7bda456b8b833d67ac30621e6671970cb7574dd9
Jul 16 16:27:00.632421 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:00.632386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:00.721408 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:00.721370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:01.315808 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:01.315777    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sg22d" event={"ID":"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf","Type":"ContainerStarted","Data":"a5f8085387fffcd85669154a7bda456b8b833d67ac30621e6671970cb7574dd9"}
Jul 16 16:27:02.321011 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.320977    2564 generic.go:356] "Generic (PLEG): container finished" podID="e1d8b8e4-7bb7-4674-9059-e722ca5f32cf" containerID="ce8863e10b27c227987f3a93a6444ce34b525f791d707060d78162a34c432916" exitCode=0
Jul 16 16:27:02.321434 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.321047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sg22d" event={"ID":"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf","Type":"ContainerDied","Data":"ce8863e10b27c227987f3a93a6444ce34b525f791d707060d78162a34c432916"}
Jul 16 16:27:02.445339 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.445302    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" podUID="0cf012c3-6aa0-473b-b42d-b14731ec012f" containerName="registry" containerID="cri-o://d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092" gracePeriod=30
Jul 16 16:27:02.604619 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.604586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:02.708583 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.708553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:02.744369 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.744333    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:27:02.826436 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826408    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-installation-pull-secrets\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.826436 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6whft\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-kube-api-access-6whft\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.826699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826561    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cf012c3-6aa0-473b-b42d-b14731ec012f-ca-trust-extracted\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.826699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-image-registry-private-configuration\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.826699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826637    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.826699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826664    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-certificates\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.826699 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826685    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-bound-sa-token\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.827045 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.826997    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-trusted-ca\") pod \"0cf012c3-6aa0-473b-b42d-b14731ec012f\" (UID: \"0cf012c3-6aa0-473b-b42d-b14731ec012f\") "
Jul 16 16:27:02.827460 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.827118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 16:27:02.827460 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.827325    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-certificates\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.827811 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.827729    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 16:27:02.829218 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.829186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:27:02.829218 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.829204    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 16:27:02.829401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.829252    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-kube-api-access-6whft" (OuterVolumeSpecName: "kube-api-access-6whft") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "kube-api-access-6whft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:27:02.829401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.829370    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:27:02.829401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.829375    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 16:27:02.835047 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.835000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf012c3-6aa0-473b-b42d-b14731ec012f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0cf012c3-6aa0-473b-b42d-b14731ec012f" (UID: "0cf012c3-6aa0-473b-b42d-b14731ec012f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 16:27:02.928188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928148    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-image-registry-private-configuration\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.928188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928177    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-registry-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.928188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928189    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-bound-sa-token\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.928188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928197    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cf012c3-6aa0-473b-b42d-b14731ec012f-trusted-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.928435 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928205    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cf012c3-6aa0-473b-b42d-b14731ec012f-installation-pull-secrets\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.928435 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928213    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6whft\" (UniqueName: \"kubernetes.io/projected/0cf012c3-6aa0-473b-b42d-b14731ec012f-kube-api-access-6whft\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:02.928435 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:02.928223    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cf012c3-6aa0-473b-b42d-b14731ec012f-ca-trust-extracted\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:27:03.002325 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.002285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:03.255090 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.255067    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ff8599596-4bmx8"
Jul 16 16:27:03.326939 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.326899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sg22d" event={"ID":"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf","Type":"ContainerStarted","Data":"f4efb25c2e2d619b34f7c9e90aa7165673967b871331c2e00eb6e94aec6e6e0a"}
Jul 16 16:27:03.327387 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.326970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sg22d" event={"ID":"e1d8b8e4-7bb7-4674-9059-e722ca5f32cf","Type":"ContainerStarted","Data":"3522f2c5455336292384a0042bf32d84d21becf6c8bceeddd8cf1d6cd323adb0"}
Jul 16 16:27:03.328365 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.328335    2564 generic.go:356] "Generic (PLEG): container finished" podID="0cf012c3-6aa0-473b-b42d-b14731ec012f" containerID="d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092" exitCode=0
Jul 16 16:27:03.328514 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.328373    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x"
Jul 16 16:27:03.328514 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.328386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" event={"ID":"0cf012c3-6aa0-473b-b42d-b14731ec012f","Type":"ContainerDied","Data":"d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092"}
Jul 16 16:27:03.328514 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.328425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656668cdb6-bzm6x" event={"ID":"0cf012c3-6aa0-473b-b42d-b14731ec012f","Type":"ContainerDied","Data":"591c5f8cd103dcca21009dba1c1f2a83060181338ddbb3d87e8969d6546271a9"}
Jul 16 16:27:03.328514 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.328451    2564 scope.go:117] "RemoveContainer" containerID="d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092"
Jul 16 16:27:03.337262 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.337244    2564 scope.go:117] "RemoveContainer" containerID="d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092"
Jul 16 16:27:03.337596 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:27:03.337576    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092\": container with ID starting with d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092 not found: ID does not exist" containerID="d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092"
Jul 16 16:27:03.337647 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.337607    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092"} err="failed to get container status \"d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092\": rpc error: code = NotFound desc = could not find container \"d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092\": container with ID starting with d2ff5765dfe3eb2ea05794099e27bcb5454488366eb0042c3924638ad172d092 not found: ID does not exist"
Jul 16 16:27:03.349240 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.349182    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sg22d" podStartSLOduration=3.369102012 podStartE2EDuration="4.349164038s" totalImagesPullingTime="898.782027ms" totalInitContainerRuntime="81.279999ms" isStatefulPod=true podCreationTimestamp="2026-07-16 16:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:27:03.349108014 +0000 UTC m=+99.009347441" watchObservedRunningTime="2026-07-16 16:27:03.349164038 +0000 UTC m=+99.009403445"
Jul 16 16:27:03.366579 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.366549    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656668cdb6-bzm6x"]
Jul 16 16:27:03.369865 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.369843    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-656668cdb6-bzm6x"]
Jul 16 16:27:03.504600 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.504567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:03.602357 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.602249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:03.977007 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:03.976968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:04.143720 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:04.143673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:04.245242 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:04.245135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:04.372860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:04.372823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:04.876863 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:04.874818    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf012c3-6aa0-473b-b42d-b14731ec012f" path="/var/lib/kubelet/pods/0cf012c3-6aa0-473b-b42d-b14731ec012f/volumes"
Jul 16 16:27:05.976376 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:05.976345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:06.104929 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:06.104874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:06.566472 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:06.566421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:06.670987 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:06.670951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:09.584308 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:09.584275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:09.678641 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:09.678614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:13.254229 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:13.254200    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sdrbr"
Jul 16 16:27:14.031379 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:14.031346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:14.136117 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:14.136083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:15.286906 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:15.286873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:15.386934 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:15.386904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:21.392201 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:21.392170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29" event={"ID":"165f9aec-01fa-42f9-b7b7-39ad685c2d92","Type":"ContainerStarted","Data":"9e63a37b3e8909232c46787b2f4abd9e3c91975e2d31821fbc9386d879cc01a7"}
Jul 16 16:27:21.698421 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:21.698382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:21.810944 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:21.810862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:22.398176 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:22.398135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29" event={"ID":"165f9aec-01fa-42f9-b7b7-39ad685c2d92","Type":"ContainerStarted","Data":"9808d16d90aba685153c63b84dc21826cc612d57caa2b32636d691fdae6f9dc6"}
Jul 16 16:27:22.398594 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:22.398189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29" event={"ID":"165f9aec-01fa-42f9-b7b7-39ad685c2d92","Type":"ContainerStarted","Data":"89a1e5c1bbdafa14aeef98a993629eeb26b7b6871f89ab5d4ddd2661a3859e9c"}
Jul 16 16:27:22.425185 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:22.425130    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5587885d4d-rhj29" podStartSLOduration=4.606784305 podStartE2EDuration="45.425112983s" totalImagesPullingTime="40.818328678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:27:22.424322034 +0000 UTC m=+118.084561439" watchObservedRunningTime="2026-07-16 16:27:22.425112983 +0000 UTC m=+118.085352387"
Jul 16 16:27:28.975695 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:28.975659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:30.286394 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:30.286355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:30.362617 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:30.362590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:31.323025 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:31.322990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:31.418750 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:31.418718    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:27:35.087733 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:27:35.087694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:15.994807 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:15.994720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:16.087756 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:16.087720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:23.670097 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:23.670064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:25.627316 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:25.627280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:25.691890 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:25.691858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:27.837288 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:27.837258    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:27.897324 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:27.897286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:36.934923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:36.934891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:37.048282 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:37.048257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:45.288002 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:45.287966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:28:45.386341 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:28:45.386311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:12.338793 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:12.338748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:12.438834 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:12.438785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:13.772920 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:13.772867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:13.874584 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:13.874550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:15.289798 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:15.289763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:41.024587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:41.024547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:41.939730 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:41.939699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:44.838826 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:44.838788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:44.938182 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:44.938139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:47.637193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:47.637103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:47.759035 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:47.758972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:49.390643 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:49.390612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:49.669297 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:49.669193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:51.658971 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:51.658939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:51.749775 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:51.749745    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:57.154738 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:57.154703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:29:57.331585 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:29:57.331547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:02.819888 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:02.819858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:02.964745 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:02.964712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:04.932248 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:04.932216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:19.273436 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:19.273401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:19.418765 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:19.418717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:19.874045 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:19.873993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:20.400718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.400676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:20.496294 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.496266    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:20.551269 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.551232    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"]
Jul 16 16:30:20.551756 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.551735    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cf012c3-6aa0-473b-b42d-b14731ec012f" containerName="registry"
Jul 16 16:30:20.551860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.551759    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf012c3-6aa0-473b-b42d-b14731ec012f" containerName="registry"
Jul 16 16:30:20.551912 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.551872    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cf012c3-6aa0-473b-b42d-b14731ec012f" containerName="registry"
Jul 16 16:30:20.555117 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.555095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.557990 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.557965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 16:30:20.558114 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.558003    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 16:30:20.558188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.558121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 16:30:20.558188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.558185    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7fcqd\""
Jul 16 16:30:20.558281 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.558245    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 16:30:20.576854 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.576824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"]
Jul 16 16:30:20.601443 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.601415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.601597 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.601456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx9h8\" (UniqueName: \"kubernetes.io/projected/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-kube-api-access-rx9h8\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.601597 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.601502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-manifests\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.601597 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.601576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-tmp\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.601707 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.601604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-webhook-cert\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.703001 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.702926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-tmp\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.703001 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.702958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-webhook-cert\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.703208 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.703013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.703208 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.703032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx9h8\" (UniqueName: \"kubernetes.io/projected/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-kube-api-access-rx9h8\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.703208 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.703049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-manifests\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.703438 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.703414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-manifests\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.705322 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.705291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-tmp\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.705559 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.705541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-webhook-cert\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.705629 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.705567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.713117 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.713093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx9h8\" (UniqueName: \"kubernetes.io/projected/abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208-kube-api-access-rx9h8\") pod \"opendatahub-operator-controller-manager-846bd4c774-x4ht7\" (UID: \"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208\") " pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.756116 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.756085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:20.857162 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.857135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:20.865120 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.865097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:20.963440 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:20.963365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:21.031447 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:21.031415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"]
Jul 16 16:30:21.034722 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:30:21.034697    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabaaf1ca_b3c3_447c_a81f_9d6e3f9dc208.slice/crio-c663a7f9bdf5fd305f5675347ad723180c29a1e64531cec73d783544edd0d03f WatchSource:0}: Error finding container c663a7f9bdf5fd305f5675347ad723180c29a1e64531cec73d783544edd0d03f: Status 404 returned error can't find the container with id c663a7f9bdf5fd305f5675347ad723180c29a1e64531cec73d783544edd0d03f
Jul 16 16:30:21.073706 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:21.073676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:21.172629 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:21.172604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:21.270667 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:21.270594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:21.980112 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:21.980069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7" event={"ID":"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208","Type":"ContainerStarted","Data":"c663a7f9bdf5fd305f5675347ad723180c29a1e64531cec73d783544edd0d03f"}
Jul 16 16:30:23.349010 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:23.348967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:23.448125 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:23.448089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:24.745586 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:24.745561    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 16:30:24.993146 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:24.993107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7" event={"ID":"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208","Type":"ContainerStarted","Data":"14e838600c76938b6f73c77810ed97c3c6e2626ca778263fc77b52e14fb2bea7"}
Jul 16 16:30:25.997765 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:25.997731    2564 generic.go:356] "Generic (PLEG): container finished" podID="abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208" containerID="14e838600c76938b6f73c77810ed97c3c6e2626ca778263fc77b52e14fb2bea7" exitCode=0
Jul 16 16:30:25.998168 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:25.997815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7" event={"ID":"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208","Type":"ContainerDied","Data":"14e838600c76938b6f73c77810ed97c3c6e2626ca778263fc77b52e14fb2bea7"}
Jul 16 16:30:25.998231 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:25.998217    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 16:30:27.003322 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:27.003286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7" event={"ID":"abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208","Type":"ContainerStarted","Data":"3c0182ea3f02e72982cbbec62e3f047858a7bfb14573d2e1f393261db49433fe"}
Jul 16 16:30:27.003750 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:27.003419    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:27.038739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:27.038669    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7" podStartSLOduration=2.356874512 podStartE2EDuration="7.038655292s" totalImagesPullingTime="3.643556833s" totalInitContainerRuntime="1.038223947s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:30:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:30:27.03590352 +0000 UTC m=+302.696142922" watchObservedRunningTime="2026-07-16 16:30:27.038655292 +0000 UTC m=+302.698894695"
Jul 16 16:30:33.582582 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:33.582545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:35.630873 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:35.630831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:38.009107 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:38.009073    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846bd4c774-x4ht7"
Jul 16 16:30:44.230435 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:44.230400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:44.396543 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:44.396507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:44.976860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:44.976827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:45.093860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.093813    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6747f69598-h72w9"]
Jul 16 16:30:45.103526 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.103499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.110722 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.110696    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 16:30:45.113083 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.113063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 16:30:45.113207 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.113092    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 16:30:45.113207 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.113092    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 16:30:45.177385 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.177352    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6747f69598-h72w9"]
Jul 16 16:30:45.189910 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.189861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjs45\" (UniqueName: \"kubernetes.io/projected/b60ce27d-4d9a-45fe-83da-60de960420f8-kube-api-access-gjs45\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.189910 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.189917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60ce27d-4d9a-45fe-83da-60de960420f8-tls-certs\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.190108 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.189979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b60ce27d-4d9a-45fe-83da-60de960420f8-tmp\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.207445 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.207411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:45.290858 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.290766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60ce27d-4d9a-45fe-83da-60de960420f8-tls-certs\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.290858 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.290815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b60ce27d-4d9a-45fe-83da-60de960420f8-tmp\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.291339 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.290879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjs45\" (UniqueName: \"kubernetes.io/projected/b60ce27d-4d9a-45fe-83da-60de960420f8-kube-api-access-gjs45\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.293334 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.293305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b60ce27d-4d9a-45fe-83da-60de960420f8-tmp\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.293645 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.293625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60ce27d-4d9a-45fe-83da-60de960420f8-tls-certs\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.303288 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.303262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjs45\" (UniqueName: \"kubernetes.io/projected/b60ce27d-4d9a-45fe-83da-60de960420f8-kube-api-access-gjs45\") pod \"kube-auth-proxy-6747f69598-h72w9\" (UID: \"b60ce27d-4d9a-45fe-83da-60de960420f8\") " pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.413609 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.413575    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9"
Jul 16 16:30:45.594372 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.594282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6747f69598-h72w9"]
Jul 16 16:30:45.595301 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.595265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:45.597225 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:30:45.597200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60ce27d_4d9a_45fe_83da_60de960420f8.slice/crio-7ff33f83b951be66d9476ba00d67be34a9250374cb03fdb7dacfb32e8de7ea2e WatchSource:0}: Error finding container 7ff33f83b951be66d9476ba00d67be34a9250374cb03fdb7dacfb32e8de7ea2e: Status 404 returned error can't find the container with id 7ff33f83b951be66d9476ba00d67be34a9250374cb03fdb7dacfb32e8de7ea2e
Jul 16 16:30:45.802746 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:45.802707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:46.056400 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:46.056367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:46.065512 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:46.065461    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9" event={"ID":"b60ce27d-4d9a-45fe-83da-60de960420f8","Type":"ContainerStarted","Data":"7ff33f83b951be66d9476ba00d67be34a9250374cb03fdb7dacfb32e8de7ea2e"}
Jul 16 16:30:46.498703 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:46.498667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:47.611193 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.611005    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tqc6k"]
Jul 16 16:30:47.614323 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.613855    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:47.618606 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.618580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-q7zkd\""
Jul 16 16:30:47.619787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.619763    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 16:30:47.623539 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.623123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:47.633253 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:47.633225    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-54d89bd5fc-tqc6k\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="22262620-38ac-4629-a526-a758fa41430c" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:47.684576 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.684539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tqc6k"]
Jul 16 16:30:47.711070 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.711033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tz5w\" (UniqueName: \"kubernetes.io/projected/22262620-38ac-4629-a526-a758fa41430c-kube-api-access-6tz5w\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:47.711255 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.711106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22262620-38ac-4629-a526-a758fa41430c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:47.812040 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.811998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tz5w\" (UniqueName: \"kubernetes.io/projected/22262620-38ac-4629-a526-a758fa41430c-kube-api-access-6tz5w\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:47.812243 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.812075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22262620-38ac-4629-a526-a758fa41430c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:47.812243 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:47.812204    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 16:30:47.812348 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:47.812275    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22262620-38ac-4629-a526-a758fa41430c-tls-certs podName:22262620-38ac-4629-a526-a758fa41430c nodeName:}" failed. No retries permitted until 2026-07-16 16:30:48.312256827 +0000 UTC m=+323.972496218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/22262620-38ac-4629-a526-a758fa41430c-tls-certs") pod "model-serving-api-54d89bd5fc-tqc6k" (UID: "22262620-38ac-4629-a526-a758fa41430c") : secret "model-serving-api-tls" not found
Jul 16 16:30:47.843223 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:47.843190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tz5w\" (UniqueName: \"kubernetes.io/projected/22262620-38ac-4629-a526-a758fa41430c-kube-api-access-6tz5w\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:48.317437 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.317238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22262620-38ac-4629-a526-a758fa41430c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:48.320560 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.320503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22262620-38ac-4629-a526-a758fa41430c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tqc6k\" (UID: \"22262620-38ac-4629-a526-a758fa41430c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:48.470719 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.470668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:48.527965 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.527934    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:48.836317 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.836281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tqc6k"]
Jul 16 16:30:48.839434 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:30:48.839410    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22262620_38ac_4629_a526_a758fa41430c.slice/crio-017f23a61811b84180af0e8852ce292a182865d95ff9ba91399210d686eb850e WatchSource:0}: Error finding container 017f23a61811b84180af0e8852ce292a182865d95ff9ba91399210d686eb850e: Status 404 returned error can't find the container with id 017f23a61811b84180af0e8852ce292a182865d95ff9ba91399210d686eb850e
Jul 16 16:30:48.978684 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.978604    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"]
Jul 16 16:30:48.980908 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:48.980890    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:48.987089 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:48.987026    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-openshift-gateway-dockercfg-wsbgv\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wsbgv\"" type="*v1.Secret"
Jul 16 16:30:48.987089 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:48.987045    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret"
Jul 16 16:30:48.987089 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:48.987052    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret"
Jul 16 16:30:48.987288 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:48.987172    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap"
Jul 16 16:30:48.987643 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:48.987622    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-tls\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret"
Jul 16 16:30:49.011227 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.011200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"]
Jul 16 16:30:49.034766 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.034696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:49.078550 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.078513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9" event={"ID":"b60ce27d-4d9a-45fe-83da-60de960420f8","Type":"ContainerStarted","Data":"93987037573db4ac25973e49a1531969fa78c09f842d2d24a4ce00847ad01ad5"}
Jul 16 16:30:49.079947 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.079873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k" event={"ID":"22262620-38ac-4629-a526-a758fa41430c","Type":"ContainerStarted","Data":"017f23a61811b84180af0e8852ce292a182865d95ff9ba91399210d686eb850e"}
Jul 16 16:30:49.113313 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.113264    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6747f69598-h72w9" podStartSLOduration=1.036098051 podStartE2EDuration="4.113248172s" totalImagesPullingTime="3.077150121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:30:49.112596345 +0000 UTC m=+324.772835750" watchObservedRunningTime="2026-07-16 16:30:49.113248172 +0000 UTC m=+324.773487575"
Jul 16 16:30:49.124964 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.124936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.125132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.124997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.125132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.125042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcb6g\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-kube-api-access-gcb6g\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.125132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.125079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-token\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.125132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.125098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.125132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.125113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f4a313-e40c-475d-a737-61c0d96ad85c-local-certs\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.125132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.125132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.184626 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.184591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:49.225928 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.225898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.226085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.225954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.226085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.225980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcb6g\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-kube-api-access-gcb6g\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.226085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.226021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-token\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.226085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.226048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.226085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.226075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f4a313-e40c-475d-a737-61c0d96ad85c-local-certs\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.226324 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.226099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.228404 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.228381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f4a313-e40c-475d-a737-61c0d96ad85c-local-certs\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.246763 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.246694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-token\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.247064 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.247042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcb6g\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-kube-api-access-gcb6g\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.831021 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.830990    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 16:30:49.838670 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.838637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:49.987442 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.987399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 16:30:49.999344 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:49.999313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:50.152857 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.152825    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wsbgv\""
Jul 16 16:30:50.226295 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:50.226265    2564 secret.go:189] Couldn't get secret openshift-ingress/cacerts: failed to sync secret cache: timed out waiting for the condition
Jul 16 16:30:50.226295 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:50.226280    2564 configmap.go:193] Couldn't get configMap openshift-ingress/openshift-gw-ca-root-cert: failed to sync configmap cache: timed out waiting for the condition
Jul 16 16:30:50.226575 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:50.226342    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap podName:11f4a313-e40c-475d-a737-61c0d96ad85c nodeName:}" failed. No retries permitted until 2026-07-16 16:30:50.726324535 +0000 UTC m=+326.386563917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-csr-ca-configmap" (UniqueName: "kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap") pod "istiod-openshift-gateway-7574459656-9t99j" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c") : failed to sync configmap cache: timed out waiting for the condition
Jul 16 16:30:50.226575 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:30:50.226356    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts podName:11f4a313-e40c-475d-a737-61c0d96ad85c nodeName:}" failed. No retries permitted until 2026-07-16 16:30:50.726348876 +0000 UTC m=+326.386588258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cacerts" (UniqueName: "kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts") pod "istiod-openshift-gateway-7574459656-9t99j" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c") : failed to sync secret cache: timed out waiting for the condition
Jul 16 16:30:50.413855 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.413765    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 16:30:50.414664 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.414649    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 16:30:50.740382 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.739119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:50.740382 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.739248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:50.740382 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.739960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:50.744139 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.743332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts\") pod \"istiod-openshift-gateway-7574459656-9t99j\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:50.790550 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.790521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:50.844154 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.844118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:50.931608 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:50.931570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"]
Jul 16 16:30:50.935908 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:30:50.935877    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f4a313_e40c_475d_a737_61c0d96ad85c.slice/crio-cd7145b78d696dab59166f51c10ab16b501d6be99eeb8df251777a2cea282da9 WatchSource:0}: Error finding container cd7145b78d696dab59166f51c10ab16b501d6be99eeb8df251777a2cea282da9: Status 404 returned error can't find the container with id cd7145b78d696dab59166f51c10ab16b501d6be99eeb8df251777a2cea282da9
Jul 16 16:30:51.089828 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:51.089730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" event={"ID":"11f4a313-e40c-475d-a737-61c0d96ad85c","Type":"ContainerStarted","Data":"cd7145b78d696dab59166f51c10ab16b501d6be99eeb8df251777a2cea282da9"}
Jul 16 16:30:53.751994 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:53.751937    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:30:53.752248 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:53.752002    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:30:54.106528 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.106425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k" event={"ID":"22262620-38ac-4629-a526-a758fa41430c","Type":"ContainerStarted","Data":"3ff01610d35d325d16a645e26da126abe8635566753f08a7bbcb297e65a4ed36"}
Jul 16 16:30:54.106681 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.106544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:30:54.108038 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.108016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" event={"ID":"11f4a313-e40c-475d-a737-61c0d96ad85c","Type":"ContainerStarted","Data":"a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924"}
Jul 16 16:30:54.108208 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.108195    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:54.109961 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.109936    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9t99j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 16:30:54.110072 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.109989    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 16:30:54.134538 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.134469    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k" podStartSLOduration=2.224355235 podStartE2EDuration="7.134450488s" totalImagesPullingTime="4.910095253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:30:54.134094675 +0000 UTC m=+329.794334079" watchObservedRunningTime="2026-07-16 16:30:54.134450488 +0000 UTC m=+329.794689893"
Jul 16 16:30:54.174085 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.174035    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" podStartSLOduration=3.360428414 podStartE2EDuration="6.174020439s" totalImagesPullingTime="2.813592025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:30:54.172701613 +0000 UTC m=+329.832941018" watchObservedRunningTime="2026-07-16 16:30:54.174020439 +0000 UTC m=+329.834259843"
Jul 16 16:30:54.598873 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.598837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:54.856549 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:54.856441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:55.112211 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:55.112127    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9t99j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 16:30:55.112211 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:55.112185    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 16:30:55.567549 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:55.567518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:55.770602 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:55.770551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:55.998614 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:55.998582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:58.112645 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.112616    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:30:58.351225 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.351190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:58.533401 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.533370    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"]
Jul 16 16:30:58.537012 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.536990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.541463 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.541445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-85cdr\""
Jul 16 16:30:58.557026 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.556999    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 16:30:58.588205 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.588170    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"]
Jul 16 16:30:58.659690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.659657    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"]
Jul 16 16:30:58.662833 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.662808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.667354 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.667335    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2v9qj\""
Jul 16 16:30:58.670934 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.670918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 16:30:58.674098 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.674077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:58.705921 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.705887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btzng\" (UniqueName: \"kubernetes.io/projected/b399ccd4-79e7-4172-9272-5877975aa6f9-kube-api-access-btzng\") pod \"kserve-controller-manager-d6f4b65b8-nxn7r\" (UID: \"b399ccd4-79e7-4172-9272-5877975aa6f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.706076 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.705975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b399ccd4-79e7-4172-9272-5877975aa6f9-cert\") pod \"kserve-controller-manager-d6f4b65b8-nxn7r\" (UID: \"b399ccd4-79e7-4172-9272-5877975aa6f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.707766 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.707741    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"]
Jul 16 16:30:58.806612 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.806518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbt7v\" (UniqueName: \"kubernetes.io/projected/8854236d-227a-4a28-bf51-cbdd414480a9-kube-api-access-kbt7v\") pod \"llmisvc-controller-manager-777c6bd7d5-8djf2\" (UID: \"8854236d-227a-4a28-bf51-cbdd414480a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.806787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.806619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzng\" (UniqueName: \"kubernetes.io/projected/b399ccd4-79e7-4172-9272-5877975aa6f9-kube-api-access-btzng\") pod \"kserve-controller-manager-d6f4b65b8-nxn7r\" (UID: \"b399ccd4-79e7-4172-9272-5877975aa6f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.806787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.806656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8854236d-227a-4a28-bf51-cbdd414480a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8djf2\" (UID: \"8854236d-227a-4a28-bf51-cbdd414480a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.806787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.806685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b399ccd4-79e7-4172-9272-5877975aa6f9-cert\") pod \"kserve-controller-manager-d6f4b65b8-nxn7r\" (UID: \"b399ccd4-79e7-4172-9272-5877975aa6f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.809315 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.809288    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b399ccd4-79e7-4172-9272-5877975aa6f9-cert\") pod \"kserve-controller-manager-d6f4b65b8-nxn7r\" (UID: \"b399ccd4-79e7-4172-9272-5877975aa6f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.821882 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.821847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btzng\" (UniqueName: \"kubernetes.io/projected/b399ccd4-79e7-4172-9272-5877975aa6f9-kube-api-access-btzng\") pod \"kserve-controller-manager-d6f4b65b8-nxn7r\" (UID: \"b399ccd4-79e7-4172-9272-5877975aa6f9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.847772 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.847746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:30:58.892196 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.892160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:58.907378 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.907334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbt7v\" (UniqueName: \"kubernetes.io/projected/8854236d-227a-4a28-bf51-cbdd414480a9-kube-api-access-kbt7v\") pod \"llmisvc-controller-manager-777c6bd7d5-8djf2\" (UID: \"8854236d-227a-4a28-bf51-cbdd414480a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.907523 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.907411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8854236d-227a-4a28-bf51-cbdd414480a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8djf2\" (UID: \"8854236d-227a-4a28-bf51-cbdd414480a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.910206 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.910179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8854236d-227a-4a28-bf51-cbdd414480a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8djf2\" (UID: \"8854236d-227a-4a28-bf51-cbdd414480a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.922132 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.922104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbt7v\" (UniqueName: \"kubernetes.io/projected/8854236d-227a-4a28-bf51-cbdd414480a9-kube-api-access-kbt7v\") pod \"llmisvc-controller-manager-777c6bd7d5-8djf2\" (UID: \"8854236d-227a-4a28-bf51-cbdd414480a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:58.972897 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:58.972861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:30:59.030814 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:59.030714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"]
Jul 16 16:30:59.034354 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:30:59.034323    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb399ccd4_79e7_4172_9272_5877975aa6f9.slice/crio-0e6eb581e7730a418ceb3feabea26a71ad7649d23fb9b4d864ad2a5e02a0c54c WatchSource:0}: Error finding container 0e6eb581e7730a418ceb3feabea26a71ad7649d23fb9b4d864ad2a5e02a0c54c: Status 404 returned error can't find the container with id 0e6eb581e7730a418ceb3feabea26a71ad7649d23fb9b4d864ad2a5e02a0c54c
Jul 16 16:30:59.090563 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:59.090467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:30:59.127016 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:59.126975    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r" event={"ID":"b399ccd4-79e7-4172-9272-5877975aa6f9","Type":"ContainerStarted","Data":"0e6eb581e7730a418ceb3feabea26a71ad7649d23fb9b4d864ad2a5e02a0c54c"}
Jul 16 16:30:59.157629 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:59.157594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"]
Jul 16 16:30:59.160910 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:30:59.160881    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8854236d_227a_4a28_bf51_cbdd414480a9.slice/crio-f8f740e2f8d89851159ca03ef3ce301a421003de94596a6e5fe3151507a953ab WatchSource:0}: Error finding container f8f740e2f8d89851159ca03ef3ce301a421003de94596a6e5fe3151507a953ab: Status 404 returned error can't find the container with id f8f740e2f8d89851159ca03ef3ce301a421003de94596a6e5fe3151507a953ab
Jul 16 16:30:59.250152 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:30:59.250108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:31:00.132904 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:00.132861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2" event={"ID":"8854236d-227a-4a28-bf51-cbdd414480a9","Type":"ContainerStarted","Data":"f8f740e2f8d89851159ca03ef3ce301a421003de94596a6e5fe3151507a953ab"}
Jul 16 16:31:00.706341 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:00.706307    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"]
Jul 16 16:31:00.706603 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:00.706577    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerName="discovery" containerID="cri-o://a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924" gracePeriod=30
Jul 16 16:31:01.050250 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.050221    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:31:01.138714 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.138679    2564 generic.go:356] "Generic (PLEG): container finished" podID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerID="a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924" exitCode=0
Jul 16 16:31:01.139177 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.138738    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"
Jul 16 16:31:01.139177 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.138764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" event={"ID":"11f4a313-e40c-475d-a737-61c0d96ad85c","Type":"ContainerDied","Data":"a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924"}
Jul 16 16:31:01.139177 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.138826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9t99j" event={"ID":"11f4a313-e40c-475d-a737-61c0d96ad85c","Type":"ContainerDied","Data":"cd7145b78d696dab59166f51c10ab16b501d6be99eeb8df251777a2cea282da9"}
Jul 16 16:31:01.139177 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.138855    2564 scope.go:117] "RemoveContainer" containerID="a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924"
Jul 16 16:31:01.148661 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.148640    2564 scope.go:117] "RemoveContainer" containerID="a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924"
Jul 16 16:31:01.148979 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:31:01.148950    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924\": container with ID starting with a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924 not found: ID does not exist" containerID="a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924"
Jul 16 16:31:01.149080 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.148986    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924"} err="failed to get container status \"a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924\": rpc error: code = NotFound desc = could not find container \"a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924\": container with ID starting with a747f3c2fcd42e08d871abf9f0b3666c9fa5681e49b631900a1e7f50911a9924 not found: ID does not exist"
Jul 16 16:31:01.226471 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226392    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-token\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.226471 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226453    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.226718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226509    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f4a313-e40c-475d-a737-61c0d96ad85c-local-certs\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.226718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-kubeconfig\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.226718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226622    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcb6g\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-kube-api-access-gcb6g\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.226718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226649    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.226718 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.226681    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-dns-cert\") pod \"11f4a313-e40c-475d-a737-61c0d96ad85c\" (UID: \"11f4a313-e40c-475d-a737-61c0d96ad85c\") "
Jul 16 16:31:01.227235 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.227185    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 16:31:01.230029 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.229998    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-token" (OuterVolumeSpecName: "istio-token") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:31:01.230566 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.230531    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 16:31:01.231032 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.230997    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts" (OuterVolumeSpecName: "cacerts") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 16:31:01.231378 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.231354    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f4a313-e40c-475d-a737-61c0d96ad85c-local-certs" (OuterVolumeSpecName: "local-certs") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 16:31:01.231512 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.231470    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-kube-api-access-gcb6g" (OuterVolumeSpecName: "kube-api-access-gcb6g") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "kube-api-access-gcb6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:31:01.231872 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.231844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "11f4a313-e40c-475d-a737-61c0d96ad85c" (UID: "11f4a313-e40c-475d-a737-61c0d96ad85c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 16:31:01.328150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328108    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-kubeconfig\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.328150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328149    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcb6g\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-kube-api-access-gcb6g\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.328150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328161    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-ca-configmap\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.328405 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328173    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-csr-dns-cert\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.328405 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328189    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f4a313-e40c-475d-a737-61c0d96ad85c-istio-token\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.328405 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328205    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f4a313-e40c-475d-a737-61c0d96ad85c-cacerts\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.328405 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.328217    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f4a313-e40c-475d-a737-61c0d96ad85c-local-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:31:01.487183 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.487096    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"]
Jul 16 16:31:01.504577 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:01.504542    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9t99j"]
Jul 16 16:31:02.144891 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:02.144849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r" event={"ID":"b399ccd4-79e7-4172-9272-5877975aa6f9","Type":"ContainerStarted","Data":"a9db6929fa35202ddd1a33cb730eb9bdc3365a12f44fc1afb6bb0764cc3dfc49"}
Jul 16 16:31:02.145338 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:02.144930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:31:02.172263 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:02.172203    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r" podStartSLOduration=1.385033695 podStartE2EDuration="4.172186624s" totalImagesPullingTime="2.787152929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:31:02.170224403 +0000 UTC m=+337.830463831" watchObservedRunningTime="2026-07-16 16:31:02.172186624 +0000 UTC m=+337.832426028"
Jul 16 16:31:02.874571 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:02.874533    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" path="/var/lib/kubelet/pods/11f4a313-e40c-475d-a737-61c0d96ad85c/volumes"
Jul 16 16:31:02.954184 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:02.954098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:31:03.070526 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:03.070476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:31:03.151143 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:03.151110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2" event={"ID":"8854236d-227a-4a28-bf51-cbdd414480a9","Type":"ContainerStarted","Data":"3e585c1b413d4768663d9efc83f89ce48d998cfa740ee231b291f2bc41401fb0"}
Jul 16 16:31:03.151568 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:03.151205    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:31:03.177301 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:03.177255    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2" podStartSLOduration=1.696379912 podStartE2EDuration="5.177236668s" totalImagesPullingTime="3.480856756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:31:03.174990126 +0000 UTC m=+338.835229530" watchObservedRunningTime="2026-07-16 16:31:03.177236668 +0000 UTC m=+338.837476073"
Jul 16 16:31:05.115644 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:05.115617    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tqc6k"
Jul 16 16:31:33.156587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:33.156558    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nxn7r"
Jul 16 16:31:34.162097 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:34.162067    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8djf2"
Jul 16 16:31:45.881114 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:45.881076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:31:46.115171 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.115128    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npd96"]
Jul 16 16:31:46.115509 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.115462    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerName="discovery"
Jul 16 16:31:46.115509 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.115498    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerName="discovery"
Jul 16 16:31:46.115646 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.115602    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f4a313-e40c-475d-a737-61c0d96ad85c" containerName="discovery"
Jul 16 16:31:46.117361 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.117338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:46.122018 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.121997    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 16:31:46.123140 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.123118    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 16:31:46.127902 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.127876    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-z2blg\""
Jul 16 16:31:46.133912 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.133853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:31:46.213715 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.213669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npd96"]
Jul 16 16:31:46.260642 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.260607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp85f\" (UniqueName: \"kubernetes.io/projected/8514620f-207e-4ad6-ba0a-e6af1d939bd3-kube-api-access-cp85f\") pod \"kuadrant-operator-catalog-npd96\" (UID: \"8514620f-207e-4ad6-ba0a-e6af1d939bd3\") " pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:46.361093 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.361058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp85f\" (UniqueName: \"kubernetes.io/projected/8514620f-207e-4ad6-ba0a-e6af1d939bd3-kube-api-access-cp85f\") pod \"kuadrant-operator-catalog-npd96\" (UID: \"8514620f-207e-4ad6-ba0a-e6af1d939bd3\") " pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:46.393139 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.393061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp85f\" (UniqueName: \"kubernetes.io/projected/8514620f-207e-4ad6-ba0a-e6af1d939bd3-kube-api-access-cp85f\") pod \"kuadrant-operator-catalog-npd96\" (UID: \"8514620f-207e-4ad6-ba0a-e6af1d939bd3\") " pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:46.426800 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.426760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:46.447862 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.447833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:31:46.589606 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:46.589577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-npd96"]
Jul 16 16:31:46.592819 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:31:46.592788    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8514620f_207e_4ad6_ba0a_e6af1d939bd3.slice/crio-00425dc686be0f18d21350d34b0a96eb941650157d054e64558cf3e338a8c0b2 WatchSource:0}: Error finding container 00425dc686be0f18d21350d34b0a96eb941650157d054e64558cf3e338a8c0b2: Status 404 returned error can't find the container with id 00425dc686be0f18d21350d34b0a96eb941650157d054e64558cf3e338a8c0b2
Jul 16 16:31:47.323111 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:47.323072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-npd96" event={"ID":"8514620f-207e-4ad6-ba0a-e6af1d939bd3","Type":"ContainerStarted","Data":"00425dc686be0f18d21350d34b0a96eb941650157d054e64558cf3e338a8c0b2"}
Jul 16 16:31:49.333058 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:49.333023    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-npd96" event={"ID":"8514620f-207e-4ad6-ba0a-e6af1d939bd3","Type":"ContainerStarted","Data":"00cd72023e39f2f3eb69d3b20b5a8967df78e40f9b99bf0ab7022fefc5ee2faa"}
Jul 16 16:31:49.369701 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:49.369650    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-npd96" podStartSLOduration=1.389762557 podStartE2EDuration="3.369634178s" totalImagesPullingTime="1.979871621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:31:49.367267353 +0000 UTC m=+385.027506775" watchObservedRunningTime="2026-07-16 16:31:49.369634178 +0000 UTC m=+385.029873581"
Jul 16 16:31:56.427815 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:56.427763    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:56.428314 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:56.427868    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:56.450275 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:56.450248    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:31:57.386861 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:31:57.386833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-npd96"
Jul 16 16:32:15.345640 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:15.345606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:15.979617 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:15.979578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:16.465221 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:16.465191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:19.155886 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.155850    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"]
Jul 16 16:32:19.158991 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.158968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:19.161731 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.161709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lxp42\""
Jul 16 16:32:19.193094 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.193067    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"]
Jul 16 16:32:19.330723 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.330689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5f2k\" (UniqueName: \"kubernetes.io/projected/72408641-6bac-4f33-ac9c-38c4f86c37fe-kube-api-access-h5f2k\") pod \"authorino-operator-75cc8d5cb7-pdssg\" (UID: \"72408641-6bac-4f33-ac9c-38c4f86c37fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:19.432056 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.431983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5f2k\" (UniqueName: \"kubernetes.io/projected/72408641-6bac-4f33-ac9c-38c4f86c37fe-kube-api-access-h5f2k\") pod \"authorino-operator-75cc8d5cb7-pdssg\" (UID: \"72408641-6bac-4f33-ac9c-38c4f86c37fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:19.446047 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.446016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5f2k\" (UniqueName: \"kubernetes.io/projected/72408641-6bac-4f33-ac9c-38c4f86c37fe-kube-api-access-h5f2k\") pod \"authorino-operator-75cc8d5cb7-pdssg\" (UID: \"72408641-6bac-4f33-ac9c-38c4f86c37fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:19.468916 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.468883    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:19.607446 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:19.607420    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"]
Jul 16 16:32:19.610031 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:32:19.610009    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72408641_6bac_4f33_ac9c_38c4f86c37fe.slice/crio-a464c48cc6742b97829224c96d02d6e533ddbd69d6ce227ae10511edb37c51f9 WatchSource:0}: Error finding container a464c48cc6742b97829224c96d02d6e533ddbd69d6ce227ae10511edb37c51f9: Status 404 returned error can't find the container with id a464c48cc6742b97829224c96d02d6e533ddbd69d6ce227ae10511edb37c51f9
Jul 16 16:32:20.389964 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:20.389919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:20.453692 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:20.453607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg" event={"ID":"72408641-6bac-4f33-ac9c-38c4f86c37fe","Type":"ContainerStarted","Data":"a464c48cc6742b97829224c96d02d6e533ddbd69d6ce227ae10511edb37c51f9"}
Jul 16 16:32:21.007315 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:21.007274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:21.359092 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:21.358990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:21.618171 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:21.618135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:22.447882 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.447840    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"]
Jul 16 16:32:22.451091 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.451067    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:22.455337 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.455319    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 16:32:22.455916 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.455899    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rwks8\""
Jul 16 16:32:22.456968 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.456938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7gk6\" (UniqueName: \"kubernetes.io/projected/4e38ff0b-c336-40ba-9806-f9222d0695ef-kube-api-access-n7gk6\") pod \"dns-operator-controller-manager-864dd78c4c-z4pzq\" (UID: \"4e38ff0b-c336-40ba-9806-f9222d0695ef\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:22.462923 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.462902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg" event={"ID":"72408641-6bac-4f33-ac9c-38c4f86c37fe","Type":"ContainerStarted","Data":"d24eb8fa323a9af675c26e0dee6fc75a024f7e0298bb01c982993865fc4f5a57"}
Jul 16 16:32:22.463010 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.462945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:22.485155 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.485129    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"]
Jul 16 16:32:22.547995 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.547939    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg" podStartSLOduration=1.392705798 podStartE2EDuration="3.547922878s" totalImagesPullingTime="2.15521708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:32:22.546866291 +0000 UTC m=+418.207105695" watchObservedRunningTime="2026-07-16 16:32:22.547922878 +0000 UTC m=+418.208162282"
Jul 16 16:32:22.558322 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.558292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7gk6\" (UniqueName: \"kubernetes.io/projected/4e38ff0b-c336-40ba-9806-f9222d0695ef-kube-api-access-n7gk6\") pod \"dns-operator-controller-manager-864dd78c4c-z4pzq\" (UID: \"4e38ff0b-c336-40ba-9806-f9222d0695ef\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:22.576007 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.575971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7gk6\" (UniqueName: \"kubernetes.io/projected/4e38ff0b-c336-40ba-9806-f9222d0695ef-kube-api-access-n7gk6\") pod \"dns-operator-controller-manager-864dd78c4c-z4pzq\" (UID: \"4e38ff0b-c336-40ba-9806-f9222d0695ef\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:22.761755 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.761659    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:22.810215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.810115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:22.916456 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:22.916436    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"]
Jul 16 16:32:22.918235 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:32:22.918212    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e38ff0b_c336_40ba_9806_f9222d0695ef.slice/crio-59998aeebdf5932a618a5e08ad8d2304cc40321056f821eb7ae7c932a5a1d911 WatchSource:0}: Error finding container 59998aeebdf5932a618a5e08ad8d2304cc40321056f821eb7ae7c932a5a1d911: Status 404 returned error can't find the container with id 59998aeebdf5932a618a5e08ad8d2304cc40321056f821eb7ae7c932a5a1d911
Jul 16 16:32:23.468694 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:23.468657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq" event={"ID":"4e38ff0b-c336-40ba-9806-f9222d0695ef","Type":"ContainerStarted","Data":"59998aeebdf5932a618a5e08ad8d2304cc40321056f821eb7ae7c932a5a1d911"}
Jul 16 16:32:23.664851 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:23.664820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:24.172811 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:24.172781    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:25.044596 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:25.044569    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 16:32:25.480998 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:25.480961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq" event={"ID":"4e38ff0b-c336-40ba-9806-f9222d0695ef","Type":"ContainerStarted","Data":"660f3e8e3218dacd262c52599e45a12447b731e69ce2fb35e578d5d3c7577853"}
Jul 16 16:32:25.481384 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:25.481084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:25.538454 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:25.538410    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq" podStartSLOduration=1.4191009110000001 podStartE2EDuration="3.538393809s" totalImagesPullingTime="2.119292898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:32:25.538221934 +0000 UTC m=+421.198461338" watchObservedRunningTime="2026-07-16 16:32:25.538393809 +0000 UTC m=+421.198633216"
Jul 16 16:32:26.940773 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:26.940720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:27.883892 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.883861    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"]
Jul 16 16:32:27.886886 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.886870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:27.893735 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.893719    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r7nns\""
Jul 16 16:32:27.897357 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.897338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370748ed-4965-4cec-98c4-d431a1ef25aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:27.897451 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.897402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9mh\" (UniqueName: \"kubernetes.io/projected/370748ed-4965-4cec-98c4-d431a1ef25aa-kube-api-access-bp9mh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:27.918054 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.913921    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"]
Jul 16 16:32:27.998475 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.998443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9mh\" (UniqueName: \"kubernetes.io/projected/370748ed-4965-4cec-98c4-d431a1ef25aa-kube-api-access-bp9mh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:27.998874 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.998539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370748ed-4965-4cec-98c4-d431a1ef25aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:27.998932 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:27.998914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370748ed-4965-4cec-98c4-d431a1ef25aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:28.021358 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.021325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9mh\" (UniqueName: \"kubernetes.io/projected/370748ed-4965-4cec-98c4-d431a1ef25aa-kube-api-access-bp9mh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:28.197251 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.197161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:28.367044 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.367008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"]
Jul 16 16:32:28.372393 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:32:28.372363    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370748ed_4965_4cec_98c4_d431a1ef25aa.slice/crio-066be61e273c450275a87df37a0884928feaaa561910c36a430e296a43fbe270 WatchSource:0}: Error finding container 066be61e273c450275a87df37a0884928feaaa561910c36a430e296a43fbe270: Status 404 returned error can't find the container with id 066be61e273c450275a87df37a0884928feaaa561910c36a430e296a43fbe270
Jul 16 16:32:28.492972 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.492891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb" event={"ID":"370748ed-4965-4cec-98c4-d431a1ef25aa","Type":"ContainerStarted","Data":"066be61e273c450275a87df37a0884928feaaa561910c36a430e296a43fbe270"}
Jul 16 16:32:28.887468 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.887436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:28.954408 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.954375    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"]
Jul 16 16:32:28.958876 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.958859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:28.963442 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.963426    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kqfs5\""
Jul 16 16:32:28.998371 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:28.998342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"]
Jul 16 16:32:29.007042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.007020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cz98\" (UniqueName: \"kubernetes.io/projected/43f9ec22-57b6-4886-9a1a-3692576ed4a7-kube-api-access-9cz98\") pod \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" (UID: \"43f9ec22-57b6-4886-9a1a-3692576ed4a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:29.107636 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.107601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cz98\" (UniqueName: \"kubernetes.io/projected/43f9ec22-57b6-4886-9a1a-3692576ed4a7-kube-api-access-9cz98\") pod \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" (UID: \"43f9ec22-57b6-4886-9a1a-3692576ed4a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:29.108450 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.108425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:29.140259 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.140185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cz98\" (UniqueName: \"kubernetes.io/projected/43f9ec22-57b6-4886-9a1a-3692576ed4a7-kube-api-access-9cz98\") pod \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" (UID: \"43f9ec22-57b6-4886-9a1a-3692576ed4a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:29.268714 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.268676    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:29.442563 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.442459    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"]
Jul 16 16:32:29.456544 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.456518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:29.464994 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:32:29.464961    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f9ec22_57b6_4886_9a1a_3692576ed4a7.slice/crio-973a8a92968d760ec2b1355972da0513c63fe51748765a7a8358ba4547d0ba70 WatchSource:0}: Error finding container 973a8a92968d760ec2b1355972da0513c63fe51748765a7a8358ba4547d0ba70: Status 404 returned error can't find the container with id 973a8a92968d760ec2b1355972da0513c63fe51748765a7a8358ba4547d0ba70
Jul 16 16:32:29.497549 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.497523    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2" event={"ID":"43f9ec22-57b6-4886-9a1a-3692576ed4a7","Type":"ContainerStarted","Data":"973a8a92968d760ec2b1355972da0513c63fe51748765a7a8358ba4547d0ba70"}
Jul 16 16:32:29.719243 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:29.719140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:30.025949 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:30.025877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:31.510326 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:31.510229    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2" event={"ID":"43f9ec22-57b6-4886-9a1a-3692576ed4a7","Type":"ContainerStarted","Data":"5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b"}
Jul 16 16:32:31.510767 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:31.510414    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:31.550832 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:31.550771    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2" podStartSLOduration=1.8584545000000001 podStartE2EDuration="3.550750043s" totalImagesPullingTime="1.692295543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:32:31.542283263 +0000 UTC m=+427.202522668" watchObservedRunningTime="2026-07-16 16:32:31.550750043 +0000 UTC m=+427.210989447"
Jul 16 16:32:32.505200 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:32.505163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:32.671555 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:32.671519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:32.800435 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:32.800349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:33.471285 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:33.471254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pdssg"
Jul 16 16:32:36.487442 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:36.487413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z4pzq"
Jul 16 16:32:36.537781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:36.537745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb" event={"ID":"370748ed-4965-4cec-98c4-d431a1ef25aa","Type":"ContainerStarted","Data":"0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7"}
Jul 16 16:32:36.537966 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:36.537847    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:36.577023 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:36.576971    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb" podStartSLOduration=2.290701136 podStartE2EDuration="9.576955858s" totalImagesPullingTime="7.286254722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:32:36.575690871 +0000 UTC m=+432.235930275" watchObservedRunningTime="2026-07-16 16:32:36.576955858 +0000 UTC m=+432.237195261"
Jul 16 16:32:38.071790 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.071756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:38.200836 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.200806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:38.642728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.642678    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"]
Jul 16 16:32:38.645953 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.645929    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.650471 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.650444    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 16:32:38.650604 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.650470    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 16:32:38.650604 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.650579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6hjbv\""
Jul 16 16:32:38.666192 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.666164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"]
Jul 16 16:32:38.668634 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.668607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:38.692846 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.692811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a85c00e5-c40f-40e1-8149-660b9ada01a9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.692988 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.692860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf4nn\" (UniqueName: \"kubernetes.io/projected/a85c00e5-c40f-40e1-8149-660b9ada01a9-kube-api-access-mf4nn\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.692988 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.692943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85c00e5-c40f-40e1-8149-660b9ada01a9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.793890 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.793851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85c00e5-c40f-40e1-8149-660b9ada01a9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.794065 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.793902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a85c00e5-c40f-40e1-8149-660b9ada01a9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.794065 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.793935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf4nn\" (UniqueName: \"kubernetes.io/projected/a85c00e5-c40f-40e1-8149-660b9ada01a9-kube-api-access-mf4nn\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.794065 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:38.794007    2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 16 16:32:38.794251 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:38.794078    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a85c00e5-c40f-40e1-8149-660b9ada01a9-plugin-serving-cert podName:a85c00e5-c40f-40e1-8149-660b9ada01a9 nodeName:}" failed. No retries permitted until 2026-07-16 16:32:39.29406163 +0000 UTC m=+434.954301016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a85c00e5-c40f-40e1-8149-660b9ada01a9-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-lmfzq" (UID: "a85c00e5-c40f-40e1-8149-660b9ada01a9") : secret "plugin-serving-cert" not found
Jul 16 16:32:38.794697 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.794674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a85c00e5-c40f-40e1-8149-660b9ada01a9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.809075 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.809041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf4nn\" (UniqueName: \"kubernetes.io/projected/a85c00e5-c40f-40e1-8149-660b9ada01a9-kube-api-access-mf4nn\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:38.964054 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:38.963973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:39.298732 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:39.298613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85c00e5-c40f-40e1-8149-660b9ada01a9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:39.301152 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:39.301131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a85c00e5-c40f-40e1-8149-660b9ada01a9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmfzq\" (UID: \"a85c00e5-c40f-40e1-8149-660b9ada01a9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:39.555601 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:39.555523    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"
Jul 16 16:32:39.701640 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:39.701461    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq"]
Jul 16 16:32:39.704315 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:32:39.704289    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda85c00e5_c40f_40e1_8149_660b9ada01a9.slice/crio-549c03b9c6c58b1fe48da03129f17831488b695a7e75d838487439dac71ac0a0 WatchSource:0}: Error finding container 549c03b9c6c58b1fe48da03129f17831488b695a7e75d838487439dac71ac0a0: Status 404 returned error can't find the container with id 549c03b9c6c58b1fe48da03129f17831488b695a7e75d838487439dac71ac0a0
Jul 16 16:32:40.558628 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:40.558588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq" event={"ID":"a85c00e5-c40f-40e1-8149-660b9ada01a9","Type":"ContainerStarted","Data":"549c03b9c6c58b1fe48da03129f17831488b695a7e75d838487439dac71ac0a0"}
Jul 16 16:32:42.518757 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:42.518726    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:45.204602 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:45.204552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:45.300050 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:45.300016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:47.546871 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:47.546789    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:48.474130 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:48.474092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:48.702542 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:48.702504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:49.754646 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.754609    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"]
Jul 16 16:32:49.755131 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.754837    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" containerName="manager" containerID="cri-o://0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7" gracePeriod=2
Jul 16 16:32:49.760283 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.760252    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"]
Jul 16 16:32:49.799518 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.796903    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"]
Jul 16 16:32:49.799518 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.797372    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" containerName="manager" containerID="cri-o://5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b" gracePeriod=2
Jul 16 16:32:49.803778 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:49.803657    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:49.806880 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:49.806042    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:49.806880 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.806816    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"]
Jul 16 16:32:49.851730 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.851694    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"]
Jul 16 16:32:49.852071 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.852044    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" containerName="manager"
Jul 16 16:32:49.852071 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.852060    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" containerName="manager"
Jul 16 16:32:49.852293 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.852081    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" containerName="manager"
Jul 16 16:32:49.852293 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.852086    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" containerName="manager"
Jul 16 16:32:49.852293 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.852145    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" containerName="manager"
Jul 16 16:32:49.852293 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.852155    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" containerName="manager"
Jul 16 16:32:49.854212 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.854184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:49.875660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.875634    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"]
Jul 16 16:32:49.879329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.878749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:32:49.883646 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.883620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"]
Jul 16 16:32:49.922292 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:49.922254    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"]
Jul 16 16:32:49.938008 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:49.937855    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:49.941686 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:49.941650    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:49.944204 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:49.944171    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:32:49.987087 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:32:49.987052    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:32:50.000614 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.000566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp697\" (UniqueName: \"kubernetes.io/projected/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-kube-api-access-wp697\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrqqr\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.000768 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.000655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrqqr\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.000768 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.000683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtg8\" (UniqueName: \"kubernetes.io/projected/1107cb39-963a-4fd6-b191-e61343d97f95-kube-api-access-fqtg8\") pod \"limitador-operator-controller-manager-859d7b78bd-2z2gl\" (UID: \"1107cb39-963a-4fd6-b191-e61343d97f95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:32:50.101822 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.101734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrqqr\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.101822 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.101782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtg8\" (UniqueName: \"kubernetes.io/projected/1107cb39-963a-4fd6-b191-e61343d97f95-kube-api-access-fqtg8\") pod \"limitador-operator-controller-manager-859d7b78bd-2z2gl\" (UID: \"1107cb39-963a-4fd6-b191-e61343d97f95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:32:50.102136 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.101865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp697\" (UniqueName: \"kubernetes.io/projected/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-kube-api-access-wp697\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrqqr\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.102215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.102151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrqqr\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.119681 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.119645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp697\" (UniqueName: \"kubernetes.io/projected/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-kube-api-access-wp697\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrqqr\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.125788 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.125763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtg8\" (UniqueName: \"kubernetes.io/projected/1107cb39-963a-4fd6-b191-e61343d97f95-kube-api-access-fqtg8\") pod \"limitador-operator-controller-manager-859d7b78bd-2z2gl\" (UID: \"1107cb39-963a-4fd6-b191-e61343d97f95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:32:50.184277 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.184243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:32:50.194436 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:50.194410    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:32:51.348378 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:51.348345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:51.452550 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:51.452507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:56.164877 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:56.164847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:32:56.266773 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:32:56.266720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:02.092728 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.092704    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:33:02.095477 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.095433    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:33:02.095903 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.095593    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:33:02.098845 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.098802    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:33:02.099046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.099025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"]
Jul 16 16:33:02.100528 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:33:02.100501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1bba6e_310a_44dc_b68d_be7bfcd685ab.slice/crio-163768d1d2947bd987e32725e862368a7a267748c2d74a9ead06871a09c4e3ee WatchSource:0}: Error finding container 163768d1d2947bd987e32725e862368a7a267748c2d74a9ead06871a09c4e3ee: Status 404 returned error can't find the container with id 163768d1d2947bd987e32725e862368a7a267748c2d74a9ead06871a09c4e3ee
Jul 16 16:33:02.100827 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.100803    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:33:02.131360 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.131337    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"]
Jul 16 16:33:02.134260 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:33:02.134226    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1107cb39_963a_4fd6_b191_e61343d97f95.slice/crio-1d5e0c91399b4f4f37d879b55b3fa7ea4de0909197c6a972c12487fd14892d10 WatchSource:0}: Error finding container 1d5e0c91399b4f4f37d879b55b3fa7ea4de0909197c6a972c12487fd14892d10: Status 404 returned error can't find the container with id 1d5e0c91399b4f4f37d879b55b3fa7ea4de0909197c6a972c12487fd14892d10
Jul 16 16:33:02.211948 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.211921    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370748ed-4965-4cec-98c4-d431a1ef25aa-extensions-socket-volume\") pod \"370748ed-4965-4cec-98c4-d431a1ef25aa\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") "
Jul 16 16:33:02.212081 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.211955    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp9mh\" (UniqueName: \"kubernetes.io/projected/370748ed-4965-4cec-98c4-d431a1ef25aa-kube-api-access-bp9mh\") pod \"370748ed-4965-4cec-98c4-d431a1ef25aa\" (UID: \"370748ed-4965-4cec-98c4-d431a1ef25aa\") "
Jul 16 16:33:02.212081 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.212016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cz98\" (UniqueName: \"kubernetes.io/projected/43f9ec22-57b6-4886-9a1a-3692576ed4a7-kube-api-access-9cz98\") pod \"43f9ec22-57b6-4886-9a1a-3692576ed4a7\" (UID: \"43f9ec22-57b6-4886-9a1a-3692576ed4a7\") "
Jul 16 16:33:02.212389 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.212366    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370748ed-4965-4cec-98c4-d431a1ef25aa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "370748ed-4965-4cec-98c4-d431a1ef25aa" (UID: "370748ed-4965-4cec-98c4-d431a1ef25aa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 16:33:02.214207 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.214183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370748ed-4965-4cec-98c4-d431a1ef25aa-kube-api-access-bp9mh" (OuterVolumeSpecName: "kube-api-access-bp9mh") pod "370748ed-4965-4cec-98c4-d431a1ef25aa" (UID: "370748ed-4965-4cec-98c4-d431a1ef25aa"). InnerVolumeSpecName "kube-api-access-bp9mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:33:02.214275 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.214226    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f9ec22-57b6-4886-9a1a-3692576ed4a7-kube-api-access-9cz98" (OuterVolumeSpecName: "kube-api-access-9cz98") pod "43f9ec22-57b6-4886-9a1a-3692576ed4a7" (UID: "43f9ec22-57b6-4886-9a1a-3692576ed4a7"). InnerVolumeSpecName "kube-api-access-9cz98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:33:02.312817 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.312784    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370748ed-4965-4cec-98c4-d431a1ef25aa-extensions-socket-volume\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:02.312817 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.312812    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp9mh\" (UniqueName: \"kubernetes.io/projected/370748ed-4965-4cec-98c4-d431a1ef25aa-kube-api-access-bp9mh\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:02.312817 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.312821    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cz98\" (UniqueName: \"kubernetes.io/projected/43f9ec22-57b6-4886-9a1a-3692576ed4a7-kube-api-access-9cz98\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:02.672924 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.672645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl" event={"ID":"1107cb39-963a-4fd6-b191-e61343d97f95","Type":"ContainerStarted","Data":"e894816dc1b9cdb099bac0f8bd027dca49fffcc46d125de5127e39c242665687"}
Jul 16 16:33:02.672924 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.672712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl" event={"ID":"1107cb39-963a-4fd6-b191-e61343d97f95","Type":"ContainerStarted","Data":"1d5e0c91399b4f4f37d879b55b3fa7ea4de0909197c6a972c12487fd14892d10"}
Jul 16 16:33:02.672924 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.672740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:33:02.674598 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.674569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq" event={"ID":"a85c00e5-c40f-40e1-8149-660b9ada01a9","Type":"ContainerStarted","Data":"9e407039b6f8cb93231329379f79c7f65d9a65d6f05cacadf59ed57856d11f89"}
Jul 16 16:33:02.675254 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.675223    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:33:02.676524 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.676498    2564 generic.go:356] "Generic (PLEG): container finished" podID="370748ed-4965-4cec-98c4-d431a1ef25aa" containerID="0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7" exitCode=0
Jul 16 16:33:02.676660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.676526    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:33:02.676660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.676541    2564 scope.go:117] "RemoveContainer" containerID="0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7"
Jul 16 16:33:02.678466 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.678424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr" event={"ID":"6e1bba6e-310a-44dc-b68d-be7bfcd685ab","Type":"ContainerStarted","Data":"cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742"}
Jul 16 16:33:02.678603 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.678469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr" event={"ID":"6e1bba6e-310a-44dc-b68d-be7bfcd685ab","Type":"ContainerStarted","Data":"163768d1d2947bd987e32725e862368a7a267748c2d74a9ead06871a09c4e3ee"}
Jul 16 16:33:02.678603 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.678518    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:33:02.679899 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.679875    2564 generic.go:356] "Generic (PLEG): container finished" podID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" containerID="5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b" exitCode=0
Jul 16 16:33:02.679992 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.679917    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:33:02.685947 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.685929    2564 scope.go:117] "RemoveContainer" containerID="0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7"
Jul 16 16:33:02.686348 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.686330    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7\": container with ID starting with 0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7 not found: ID does not exist" containerID="0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7"
Jul 16 16:33:02.686441 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.686361    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7"} err="failed to get container status \"0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7\": rpc error: code = NotFound desc = could not find container \"0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7\": container with ID starting with 0e0f974eefcaae4e7f3da0f83f29e43763eef99cc49456248a41bee06c142cc7 not found: ID does not exist"
Jul 16 16:33:02.686441 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.686383    2564 scope.go:117] "RemoveContainer" containerID="5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b"
Jul 16 16:33:02.694263 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.694248    2564 scope.go:117] "RemoveContainer" containerID="5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b"
Jul 16 16:33:02.694521 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.694470    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b\": container with ID starting with 5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b not found: ID does not exist" containerID="5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b"
Jul 16 16:33:02.694591 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.694528    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b"} err="failed to get container status \"5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b\": rpc error: code = NotFound desc = could not find container \"5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b\": container with ID starting with 5a42983ce8d2059f8a0497097a49f948209318b48ea7e33d538115a9f052822b not found: ID does not exist"
Jul 16 16:33:02.698136 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.698098    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl" podStartSLOduration=13.698085768 podStartE2EDuration="13.698085768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:02.69717839 +0000 UTC m=+458.357417813" watchObservedRunningTime="2026-07-16 16:33:02.698085768 +0000 UTC m=+458.358325188"
Jul 16 16:33:02.699316 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.699288    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:33:02.720686 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.720648    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr" podStartSLOduration=13.720635543 podStartE2EDuration="13.720635543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:02.719830449 +0000 UTC m=+458.380069872" watchObservedRunningTime="2026-07-16 16:33:02.720635543 +0000 UTC m=+458.380874962"
Jul 16 16:33:02.721944 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.721920    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lb4h2\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lb4h2"
Jul 16 16:33:02.743978 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.743940    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmfzq" podStartSLOduration=2.474760629 podStartE2EDuration="24.743927978s" totalImagesPullingTime="22.269167349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:02.741964027 +0000 UTC m=+458.402203421" watchObservedRunningTime="2026-07-16 16:33:02.743927978 +0000 UTC m=+458.404167382"
Jul 16 16:33:02.745674 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:02.745646    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6bbqb\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6bbqb"
Jul 16 16:33:02.876009 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.875974    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370748ed-4965-4cec-98c4-d431a1ef25aa" path="/var/lib/kubelet/pods/370748ed-4965-4cec-98c4-d431a1ef25aa/volumes"
Jul 16 16:33:02.876414 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:02.876395    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43f9ec22-57b6-4886-9a1a-3692576ed4a7" path="/var/lib/kubelet/pods/43f9ec22-57b6-4886-9a1a-3692576ed4a7/volumes"
Jul 16 16:33:03.232878 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:03.232839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:03.457305 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:03.457270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:06.466321 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:06.466275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:06.630902 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:06.630869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:07.494617 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:07.494581    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:07.637917 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:07.637875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:10.115832 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:10.115799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:10.283956 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:10.283921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:12.225739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.225703    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"]
Jul 16 16:33:12.226183 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.225878    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr" podUID="6e1bba6e-310a-44dc-b68d-be7bfcd685ab" containerName="manager" containerID="cri-o://cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742" gracePeriod=10
Jul 16 16:33:12.227719 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.227698    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:33:12.473155 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.473133    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:33:12.594879 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.594797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp697\" (UniqueName: \"kubernetes.io/projected/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-kube-api-access-wp697\") pod \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") "
Jul 16 16:33:12.594879 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.594865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-extensions-socket-volume\") pod \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\" (UID: \"6e1bba6e-310a-44dc-b68d-be7bfcd685ab\") "
Jul 16 16:33:12.595226 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.595204    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6e1bba6e-310a-44dc-b68d-be7bfcd685ab" (UID: "6e1bba6e-310a-44dc-b68d-be7bfcd685ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 16:33:12.597088 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.597066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-kube-api-access-wp697" (OuterVolumeSpecName: "kube-api-access-wp697") pod "6e1bba6e-310a-44dc-b68d-be7bfcd685ab" (UID: "6e1bba6e-310a-44dc-b68d-be7bfcd685ab"). InnerVolumeSpecName "kube-api-access-wp697". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:33:12.695967 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.695941    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-extensions-socket-volume\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:12.695967 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.695964    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp697\" (UniqueName: \"kubernetes.io/projected/6e1bba6e-310a-44dc-b68d-be7bfcd685ab-kube-api-access-wp697\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:12.725919 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.725890    2564 generic.go:356] "Generic (PLEG): container finished" podID="6e1bba6e-310a-44dc-b68d-be7bfcd685ab" containerID="cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742" exitCode=0
Jul 16 16:33:12.726080 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.725936    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"
Jul 16 16:33:12.726080 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.725967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr" event={"ID":"6e1bba6e-310a-44dc-b68d-be7bfcd685ab","Type":"ContainerDied","Data":"cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742"}
Jul 16 16:33:12.726080 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.726007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr" event={"ID":"6e1bba6e-310a-44dc-b68d-be7bfcd685ab","Type":"ContainerDied","Data":"163768d1d2947bd987e32725e862368a7a267748c2d74a9ead06871a09c4e3ee"}
Jul 16 16:33:12.726080 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.726030    2564 scope.go:117] "RemoveContainer" containerID="cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742"
Jul 16 16:33:12.740905 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.740880    2564 scope.go:117] "RemoveContainer" containerID="cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742"
Jul 16 16:33:12.741193 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:12.741171    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742\": container with ID starting with cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742 not found: ID does not exist" containerID="cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742"
Jul 16 16:33:12.741232 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.741203    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742"} err="failed to get container status \"cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742\": rpc error: code = NotFound desc = could not find container \"cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742\": container with ID starting with cb0ff9d24a16ac4f8f88df5dcafd15a753ded4dc2caab2f9e01b8dd05204a742 not found: ID does not exist"
Jul 16 16:33:12.765346 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.765321    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"]
Jul 16 16:33:12.771538 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.771515    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrqqr"]
Jul 16 16:33:12.874856 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:12.874828    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1bba6e-310a-44dc-b68d-be7bfcd685ab" path="/var/lib/kubelet/pods/6e1bba6e-310a-44dc-b68d-be7bfcd685ab/volumes"
Jul 16 16:33:13.688519 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:13.688468    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2z2gl"
Jul 16 16:33:15.300311 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:15.300275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:15.412883 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:15.412857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:23.597500 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:23.597459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:23.769464 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:23.769431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:28.928266 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:28.928230    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"]
Jul 16 16:33:28.928720 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:28.928695    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1bba6e-310a-44dc-b68d-be7bfcd685ab" containerName="manager"
Jul 16 16:33:28.928720 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:28.928710    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1bba6e-310a-44dc-b68d-be7bfcd685ab" containerName="manager"
Jul 16 16:33:28.928806 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:28.928790    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1bba6e-310a-44dc-b68d-be7bfcd685ab" containerName="manager"
Jul 16 16:33:28.976811 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:28.976772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:29.335846 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.335759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"]
Jul 16 16:33:29.336020 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.335867    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.344367 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.344344    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5cg8z\""
Jul 16 16:33:29.344636 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.344621    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 16:33:29.427447 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427447 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94539fa2-827f-4e7f-90a8-c9c846b78917-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xbj\" (UniqueName: \"kubernetes.io/projected/94539fa2-827f-4e7f-90a8-c9c846b78917-kube-api-access-n9xbj\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.427781 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.427706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.490968 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.490930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:29.529046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529263 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529263 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529263 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529422 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94539fa2-827f-4e7f-90a8-c9c846b78917-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529422 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xbj\" (UniqueName: \"kubernetes.io/projected/94539fa2-827f-4e7f-90a8-c9c846b78917-kube-api-access-n9xbj\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529422 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529422 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529665 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529665 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.529764 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.529728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.530121 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.530098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94539fa2-827f-4e7f-90a8-c9c846b78917-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.530190 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.530102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.531608 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.531585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.531838 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.531823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.553049 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.553027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94539fa2-827f-4e7f-90a8-c9c846b78917-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.554977 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.554950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xbj\" (UniqueName: \"kubernetes.io/projected/94539fa2-827f-4e7f-90a8-c9c846b78917-kube-api-access-n9xbj\") pod \"maas-default-gateway-openshift-default-56654dcf7-mxsn4\" (UID: \"94539fa2-827f-4e7f-90a8-c9c846b78917\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.646304 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.646271    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:29.910871 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:29.910780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"]
Jul 16 16:33:29.913302 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:33:29.913273    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94539fa2_827f_4e7f_90a8_c9c846b78917.slice/crio-e492ff45c874651274c0b6632839f75473e772a95226b1805accd06a2c1dbc60 WatchSource:0}: Error finding container e492ff45c874651274c0b6632839f75473e772a95226b1805accd06a2c1dbc60: Status 404 returned error can't find the container with id e492ff45c874651274c0b6632839f75473e772a95226b1805accd06a2c1dbc60
Jul 16 16:33:30.803495 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:30.803443    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" event={"ID":"94539fa2-827f-4e7f-90a8-c9c846b78917","Type":"ContainerStarted","Data":"e492ff45c874651274c0b6632839f75473e772a95226b1805accd06a2c1dbc60"}
Jul 16 16:33:32.737521 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:32.737462    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:33:32.737780 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:32.737558    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:33:32.737780 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:32.737588    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:33:32.815875 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:32.815833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" event={"ID":"94539fa2-827f-4e7f-90a8-c9c846b78917","Type":"ContainerStarted","Data":"2ad3cdcc838380e6545df0d92bc5b5ca25263ac9b534505880349a9e42882d0c"}
Jul 16 16:33:32.837916 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:32.837856    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" podStartSLOduration=2.016024966 podStartE2EDuration="4.837835968s" totalImagesPullingTime="2.821811002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:32.837592014 +0000 UTC m=+488.497831415" watchObservedRunningTime="2026-07-16 16:33:32.837835968 +0000 UTC m=+488.498075375"
Jul 16 16:33:33.646929 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.646894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:33.651506 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.651456    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:33.819793 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.819761    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:33.820700 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.820684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:33:33.965227 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.965113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:33.966124 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.966102    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:33.969238 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.969222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:33.972836 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.972817    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 16:33:33.982843 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:33.982815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:34.059611 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.059580    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:34.066134 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.066112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/837e60a3-df54-4618-bb05-16086e368177-config-file\") pod \"limitador-limitador-64c94fd64f-sp4m4\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.066259 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.066167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5r8\" (UniqueName: \"kubernetes.io/projected/837e60a3-df54-4618-bb05-16086e368177-kube-api-access-7d5r8\") pod \"limitador-limitador-64c94fd64f-sp4m4\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.074527 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.074468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:34.167655 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.167617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/837e60a3-df54-4618-bb05-16086e368177-config-file\") pod \"limitador-limitador-64c94fd64f-sp4m4\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.167866 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.167686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5r8\" (UniqueName: \"kubernetes.io/projected/837e60a3-df54-4618-bb05-16086e368177-kube-api-access-7d5r8\") pod \"limitador-limitador-64c94fd64f-sp4m4\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.168444 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.168427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/837e60a3-df54-4618-bb05-16086e368177-config-file\") pod \"limitador-limitador-64c94fd64f-sp4m4\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.174855 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.174824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:34.178517 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.178471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5r8\" (UniqueName: \"kubernetes.io/projected/837e60a3-df54-4618-bb05-16086e368177-kube-api-access-7d5r8\") pod \"limitador-limitador-64c94fd64f-sp4m4\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.279545 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.279431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:34.373903 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.373869    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:33:34.378382 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.378355    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.393959 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.393913    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:33:34.428344 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.428308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:33:34.435521 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.435477    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:34.438105 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:33:34.438081    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837e60a3_df54_4618_bb05_16086e368177.slice/crio-bff1f3e271715840ebd0c4227e779142343ec1f674bbf0a35375612d58b22a20 WatchSource:0}: Error finding container bff1f3e271715840ebd0c4227e779142343ec1f674bbf0a35375612d58b22a20: Status 404 returned error can't find the container with id bff1f3e271715840ebd0c4227e779142343ec1f674bbf0a35375612d58b22a20
Jul 16 16:33:34.470431 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.470401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfgxn\" (UniqueName: \"kubernetes.io/projected/4000da2b-26b8-4c82-a09c-e687e237bf60-kube-api-access-wfgxn\") pod \"limitador-limitador-54d6d988d5-nl7sx\" (UID: \"4000da2b-26b8-4c82-a09c-e687e237bf60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.470624 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.470467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4000da2b-26b8-4c82-a09c-e687e237bf60-config-file\") pod \"limitador-limitador-54d6d988d5-nl7sx\" (UID: \"4000da2b-26b8-4c82-a09c-e687e237bf60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.571862 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.571767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4000da2b-26b8-4c82-a09c-e687e237bf60-config-file\") pod \"limitador-limitador-54d6d988d5-nl7sx\" (UID: \"4000da2b-26b8-4c82-a09c-e687e237bf60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.571862 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.571827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfgxn\" (UniqueName: \"kubernetes.io/projected/4000da2b-26b8-4c82-a09c-e687e237bf60-kube-api-access-wfgxn\") pod \"limitador-limitador-54d6d988d5-nl7sx\" (UID: \"4000da2b-26b8-4c82-a09c-e687e237bf60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.572416 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.572398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4000da2b-26b8-4c82-a09c-e687e237bf60-config-file\") pod \"limitador-limitador-54d6d988d5-nl7sx\" (UID: \"4000da2b-26b8-4c82-a09c-e687e237bf60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.582926 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.582900    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfgxn\" (UniqueName: \"kubernetes.io/projected/4000da2b-26b8-4c82-a09c-e687e237bf60-kube-api-access-wfgxn\") pod \"limitador-limitador-54d6d988d5-nl7sx\" (UID: \"4000da2b-26b8-4c82-a09c-e687e237bf60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.692231 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.692191    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:34.825463 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.825379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4" event={"ID":"837e60a3-df54-4618-bb05-16086e368177","Type":"ContainerStarted","Data":"bff1f3e271715840ebd0c4227e779142343ec1f674bbf0a35375612d58b22a20"}
Jul 16 16:33:34.843760 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.843721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:33:34.846008 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:33:34.845975    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4000da2b_26b8_4c82_a09c_e687e237bf60.slice/crio-6c648c7ce2141315f6e2f9137d650c438085771939b626a5805c6feff23b7e97 WatchSource:0}: Error finding container 6c648c7ce2141315f6e2f9137d650c438085771939b626a5805c6feff23b7e97: Status 404 returned error can't find the container with id 6c648c7ce2141315f6e2f9137d650c438085771939b626a5805c6feff23b7e97
Jul 16 16:33:34.874771 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.874729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:34.981031 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:34.980995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:35.268794 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:35.268758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:35.833536 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:35.833463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx" event={"ID":"4000da2b-26b8-4c82-a09c-e687e237bf60","Type":"ContainerStarted","Data":"6c648c7ce2141315f6e2f9137d650c438085771939b626a5805c6feff23b7e97"}
Jul 16 16:33:37.851061 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:37.850964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4" event={"ID":"837e60a3-df54-4618-bb05-16086e368177","Type":"ContainerStarted","Data":"d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9"}
Jul 16 16:33:37.851462 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:37.851062    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:37.852534 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:37.852513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx" event={"ID":"4000da2b-26b8-4c82-a09c-e687e237bf60","Type":"ContainerStarted","Data":"cd053e2daebf4e6d5cd0cd45246cd66cebf94d4923b2ff73c367de19deb74723"}
Jul 16 16:33:37.852670 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:37.852625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:37.870894 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:37.870843    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4" podStartSLOduration=1.755048006 podStartE2EDuration="4.87082872s" totalImagesPullingTime="3.115780714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:37.869415226 +0000 UTC m=+493.529654696" watchObservedRunningTime="2026-07-16 16:33:37.87082872 +0000 UTC m=+493.531068153"
Jul 16 16:33:48.858016 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:48.857984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:48.858416 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:48.858057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"
Jul 16 16:33:48.879263 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:48.879216    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nl7sx" podStartSLOduration=12.160630585 podStartE2EDuration="14.879201293s" totalImagesPullingTime="2.718570708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:37.890758919 +0000 UTC m=+493.550998324" watchObservedRunningTime="2026-07-16 16:33:48.879201293 +0000 UTC m=+504.539440697"
Jul 16 16:33:48.933747 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:48.933711    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:48.933920 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:48.933895    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4" podUID="837e60a3-df54-4618-bb05-16086e368177" containerName="limitador" containerID="cri-o://d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9" gracePeriod=30
Jul 16 16:33:49.874225 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.874204    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:49.904158 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.904123    2564 generic.go:356] "Generic (PLEG): container finished" podID="837e60a3-df54-4618-bb05-16086e368177" containerID="d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9" exitCode=0
Jul 16 16:33:49.904335 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.904173    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"
Jul 16 16:33:49.904335 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.904171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4" event={"ID":"837e60a3-df54-4618-bb05-16086e368177","Type":"ContainerDied","Data":"d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9"}
Jul 16 16:33:49.904335 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.904303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sp4m4" event={"ID":"837e60a3-df54-4618-bb05-16086e368177","Type":"ContainerDied","Data":"bff1f3e271715840ebd0c4227e779142343ec1f674bbf0a35375612d58b22a20"}
Jul 16 16:33:49.904520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.904343    2564 scope.go:117] "RemoveContainer" containerID="d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9"
Jul 16 16:33:49.912953 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.912939    2564 scope.go:117] "RemoveContainer" containerID="d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9"
Jul 16 16:33:49.913235 ip-10-0-128-205 kubenswrapper[2564]: E0716 16:33:49.913213    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9\": container with ID starting with d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9 not found: ID does not exist" containerID="d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9"
Jul 16 16:33:49.913326 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:49.913244    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9"} err="failed to get container status \"d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9\": rpc error: code = NotFound desc = could not find container \"d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9\": container with ID starting with d0b7d5ff33090174f3d6eaefd68bbaec20d213d4d4cbaa72f0466d0ddf8536e9 not found: ID does not exist"
Jul 16 16:33:50.005572 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.005493    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/837e60a3-df54-4618-bb05-16086e368177-config-file\") pod \"837e60a3-df54-4618-bb05-16086e368177\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") "
Jul 16 16:33:50.005727 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.005601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d5r8\" (UniqueName: \"kubernetes.io/projected/837e60a3-df54-4618-bb05-16086e368177-kube-api-access-7d5r8\") pod \"837e60a3-df54-4618-bb05-16086e368177\" (UID: \"837e60a3-df54-4618-bb05-16086e368177\") "
Jul 16 16:33:50.005870 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.005843    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837e60a3-df54-4618-bb05-16086e368177-config-file" (OuterVolumeSpecName: "config-file") pod "837e60a3-df54-4618-bb05-16086e368177" (UID: "837e60a3-df54-4618-bb05-16086e368177"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 16:33:50.007759 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.007735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/837e60a3-df54-4618-bb05-16086e368177-kube-api-access-7d5r8" (OuterVolumeSpecName: "kube-api-access-7d5r8") pod "837e60a3-df54-4618-bb05-16086e368177" (UID: "837e60a3-df54-4618-bb05-16086e368177"). InnerVolumeSpecName "kube-api-access-7d5r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 16:33:50.106597 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.106558    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d5r8\" (UniqueName: \"kubernetes.io/projected/837e60a3-df54-4618-bb05-16086e368177-kube-api-access-7d5r8\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:50.106597 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.106590    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/837e60a3-df54-4618-bb05-16086e368177-config-file\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 16:33:50.238580 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.238549    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:50.246172 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.246143    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sp4m4"]
Jul 16 16:33:50.260309 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.260226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:50.331467 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.331438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:50.754215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.754182    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"]
Jul 16 16:33:50.754561 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.754547    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="837e60a3-df54-4618-bb05-16086e368177" containerName="limitador"
Jul 16 16:33:50.754658 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.754563    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="837e60a3-df54-4618-bb05-16086e368177" containerName="limitador"
Jul 16 16:33:50.754658 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.754632    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="837e60a3-df54-4618-bb05-16086e368177" containerName="limitador"
Jul 16 16:33:50.757189 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.757169    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:50.760172 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.760152    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 16:33:50.760273 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.760162    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dx269\""
Jul 16 16:33:50.761129 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.761116    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 16:33:50.761182 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.761118    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 16:33:50.769316 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.769296    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"]
Jul 16 16:33:50.796801 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.796772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:33:50.874660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.874625    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="837e60a3-df54-4618-bb05-16086e368177" path="/var/lib/kubelet/pods/837e60a3-df54-4618-bb05-16086e368177/volumes"
Jul 16 16:33:50.913814 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.913787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb8xq\" (UniqueName: \"kubernetes.io/projected/d2e01328-d62b-413f-945d-bb8ab173f5b3-kube-api-access-mb8xq\") pod \"postgres-69fb4594cf-42s2n\" (UID: \"d2e01328-d62b-413f-945d-bb8ab173f5b3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:50.913814 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:50.913819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d2e01328-d62b-413f-945d-bb8ab173f5b3-data\") pod \"postgres-69fb4594cf-42s2n\" (UID: \"d2e01328-d62b-413f-945d-bb8ab173f5b3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:51.014732 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.014642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb8xq\" (UniqueName: \"kubernetes.io/projected/d2e01328-d62b-413f-945d-bb8ab173f5b3-kube-api-access-mb8xq\") pod \"postgres-69fb4594cf-42s2n\" (UID: \"d2e01328-d62b-413f-945d-bb8ab173f5b3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:51.014732 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.014679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d2e01328-d62b-413f-945d-bb8ab173f5b3-data\") pod \"postgres-69fb4594cf-42s2n\" (UID: \"d2e01328-d62b-413f-945d-bb8ab173f5b3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:51.015107 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.015086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d2e01328-d62b-413f-945d-bb8ab173f5b3-data\") pod \"postgres-69fb4594cf-42s2n\" (UID: \"d2e01328-d62b-413f-945d-bb8ab173f5b3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:51.027399 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.027369    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb8xq\" (UniqueName: \"kubernetes.io/projected/d2e01328-d62b-413f-945d-bb8ab173f5b3-kube-api-access-mb8xq\") pod \"postgres-69fb4594cf-42s2n\" (UID: \"d2e01328-d62b-413f-945d-bb8ab173f5b3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:51.067452 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.067412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:51.207539 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.207512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"]
Jul 16 16:33:51.210110 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:33:51.210081    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e01328_d62b_413f_945d_bb8ab173f5b3.slice/crio-dc722acd8f23edf5da080253478a14ac052a5eb9c9ac464d6da26af074794852 WatchSource:0}: Error finding container dc722acd8f23edf5da080253478a14ac052a5eb9c9ac464d6da26af074794852: Status 404 returned error can't find the container with id dc722acd8f23edf5da080253478a14ac052a5eb9c9ac464d6da26af074794852
Jul 16 16:33:51.917812 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:51.917770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n" event={"ID":"d2e01328-d62b-413f-945d-bb8ab173f5b3","Type":"ContainerStarted","Data":"dc722acd8f23edf5da080253478a14ac052a5eb9c9ac464d6da26af074794852"}
Jul 16 16:33:56.943885 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:56.943794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n" event={"ID":"d2e01328-d62b-413f-945d-bb8ab173f5b3","Type":"ContainerStarted","Data":"1c370f46c57512dd33df19cdc834fa8c21c10b34b658937846a014d013245401"}
Jul 16 16:33:56.944250 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:56.943909    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:33:56.969746 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:33:56.969694    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n" podStartSLOduration=1.52968126 podStartE2EDuration="6.969677424s" totalImagesPullingTime="5.439996164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:33:56.967993097 +0000 UTC m=+512.628232526" watchObservedRunningTime="2026-07-16 16:33:56.969677424 +0000 UTC m=+512.629916828"
Jul 16 16:34:02.978579 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:02.978550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-42s2n"
Jul 16 16:34:03.338546 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:03.338440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:03.852005 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:03.851971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:10.603170 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:10.603131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:10.710331 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:10.710297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:10.810677 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:10.810645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:11.172164 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:11.172135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:11.579544 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:11.579429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:14.459788 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:14.459757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:14.533107 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:14.533066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:23.328598 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:23.328470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:47.380444 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:47.380407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:47.480119 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:47.480085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:47.942680 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:47.942648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:48.077368 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.077330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:48.572796 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.572759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:48.671061 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.671031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:48.719518 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.719467    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pw48m"]
Jul 16 16:34:48.727339 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.727304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:48.730018 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.729996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l77qm\""
Jul 16 16:34:48.730157 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.729996    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 16:34:48.739713 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.739691    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pw48m"]
Jul 16 16:34:48.792313 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.792269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:34:48.799131 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.799097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aad3389-e684-4fc3-8a91-1db6c2d3ef29-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pw48m\" (UID: \"4aad3389-e684-4fc3-8a91-1db6c2d3ef29\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:48.799287 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.799154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658sp\" (UniqueName: \"kubernetes.io/projected/4aad3389-e684-4fc3-8a91-1db6c2d3ef29-kube-api-access-658sp\") pod \"payload-processing-f9b8d9b9b-pw48m\" (UID: \"4aad3389-e684-4fc3-8a91-1db6c2d3ef29\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:48.900680 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.900640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-658sp\" (UniqueName: \"kubernetes.io/projected/4aad3389-e684-4fc3-8a91-1db6c2d3ef29-kube-api-access-658sp\") pod \"payload-processing-f9b8d9b9b-pw48m\" (UID: \"4aad3389-e684-4fc3-8a91-1db6c2d3ef29\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:48.900883 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.900751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aad3389-e684-4fc3-8a91-1db6c2d3ef29-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pw48m\" (UID: \"4aad3389-e684-4fc3-8a91-1db6c2d3ef29\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:48.901624 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.901594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aad3389-e684-4fc3-8a91-1db6c2d3ef29-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-pw48m\" (UID: \"4aad3389-e684-4fc3-8a91-1db6c2d3ef29\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:48.909327 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:48.909292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-658sp\" (UniqueName: \"kubernetes.io/projected/4aad3389-e684-4fc3-8a91-1db6c2d3ef29-kube-api-access-658sp\") pod \"payload-processing-f9b8d9b9b-pw48m\" (UID: \"4aad3389-e684-4fc3-8a91-1db6c2d3ef29\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:49.038944 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:49.038908    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:49.195682 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:49.195594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-pw48m"]
Jul 16 16:34:49.198817 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:34:49.198776    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aad3389_e684_4fc3_8a91_1db6c2d3ef29.slice/crio-963ce7e733d01b6c3c3d6576fc19837da5288e0419c6d7b0b7d4d3804daf5487 WatchSource:0}: Error finding container 963ce7e733d01b6c3c3d6576fc19837da5288e0419c6d7b0b7d4d3804daf5487: Status 404 returned error can't find the container with id 963ce7e733d01b6c3c3d6576fc19837da5288e0419c6d7b0b7d4d3804daf5487
Jul 16 16:34:50.200252 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:50.200213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m" event={"ID":"4aad3389-e684-4fc3-8a91-1db6c2d3ef29","Type":"ContainerStarted","Data":"963ce7e733d01b6c3c3d6576fc19837da5288e0419c6d7b0b7d4d3804daf5487"}
Jul 16 16:34:51.207385 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:51.207351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m" event={"ID":"4aad3389-e684-4fc3-8a91-1db6c2d3ef29","Type":"ContainerStarted","Data":"3696c3c2a0d39d01a64333fa1650f832cab38972376e9c2718147c2158efe066"}
Jul 16 16:34:51.207808 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:51.207516    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:34:51.229271 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:51.229218    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m" podStartSLOduration=1.624598313 podStartE2EDuration="3.229199962s" totalImagesPullingTime="1.604601649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:34:51.227386666 +0000 UTC m=+566.887626085" watchObservedRunningTime="2026-07-16 16:34:51.229199962 +0000 UTC m=+566.889439366"
Jul 16 16:34:56.236335 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:56.236295    2564 generic.go:356] "Generic (PLEG): container finished" podID="94539fa2-827f-4e7f-90a8-c9c846b78917" containerID="2ad3cdcc838380e6545df0d92bc5b5ca25263ac9b534505880349a9e42882d0c" exitCode=0
Jul 16 16:34:56.236335 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:56.236338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" event={"ID":"94539fa2-827f-4e7f-90a8-c9c846b78917","Type":"ContainerDied","Data":"2ad3cdcc838380e6545df0d92bc5b5ca25263ac9b534505880349a9e42882d0c"}
Jul 16 16:34:56.236956 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:56.236867    2564 scope.go:117] "RemoveContainer" containerID="2ad3cdcc838380e6545df0d92bc5b5ca25263ac9b534505880349a9e42882d0c"
Jul 16 16:34:56.237956 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:56.237926    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:34:56.238042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:56.237997    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:34:56.238042 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:56.238030    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 16:34:57.243865 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:57.243829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" event={"ID":"94539fa2-827f-4e7f-90a8-c9c846b78917","Type":"ContainerStarted","Data":"02d16c36170993a2296b3728609909846b04aa18642d5437114a3ba06df00744"}
Jul 16 16:34:57.646581 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:57.646544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:34:57.646817 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:57.646798    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 16:34:57.646879 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:57.646858    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" podUID="94539fa2-827f-4e7f-90a8-c9c846b78917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 16:34:58.647034 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:58.646995    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 16:34:58.647430 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:58.647052    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" podUID="94539fa2-827f-4e7f-90a8-c9c846b78917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 16:34:59.647258 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:59.647219    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 16:34:59.647739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:59.647285    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" podUID="94539fa2-827f-4e7f-90a8-c9c846b78917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 16:34:59.694072 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:59.694025    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:34:59.784676 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:34:59.784627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:00.647047 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:00.647007    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mxsn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 16:35:00.647240 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:00.647072    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4" podUID="94539fa2-827f-4e7f-90a8-c9c846b78917" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 16:35:01.651145 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:01.651104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:35:01.651565 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:01.651383    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:35:01.652218 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:01.652198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mxsn4"
Jul 16 16:35:02.217116 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:02.217084    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-pw48m"
Jul 16 16:35:12.222234 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.222198    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"]
Jul 16 16:35:12.227322 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.227302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.231355 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.231315    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 16:35:12.231539 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.231438    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 16:35:12.232366 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.232351    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 16:35:12.232417 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.232383    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p8r4s\""
Jul 16 16:35:12.240065 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.240041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"]
Jul 16 16:35:12.263441 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.263399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:12.308819 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.308790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.308819 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.308823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.309021 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.308842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.309021 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.308936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2ng\" (UniqueName: \"kubernetes.io/projected/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-kube-api-access-zg2ng\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.309021 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.308993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.309118 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.309020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410379 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410379 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410700 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410531    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410700 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410700 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410700 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2ng\" (UniqueName: \"kubernetes.io/projected/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-kube-api-access-zg2ng\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410911 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410911 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.410911 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.410897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.413024 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.412994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.413321 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.413302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.420063 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.420041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2ng\" (UniqueName: \"kubernetes.io/projected/5778f0dd-c09c-4d21-a1b5-05e61fe9476d-kube-api-access-zg2ng\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr\" (UID: \"5778f0dd-c09c-4d21-a1b5-05e61fe9476d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.506226 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.506133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:35:12.538086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.538042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:12.678797 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:12.678770    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"]
Jul 16 16:35:12.681221 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:35:12.681191    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5778f0dd_c09c_4d21_a1b5_05e61fe9476d.slice/crio-dd0190f3eb085881d526bebcc2e97c9c13977de0cf7bbc6e1cfb3f958c1c08b2 WatchSource:0}: Error finding container dd0190f3eb085881d526bebcc2e97c9c13977de0cf7bbc6e1cfb3f958c1c08b2: Status 404 returned error can't find the container with id dd0190f3eb085881d526bebcc2e97c9c13977de0cf7bbc6e1cfb3f958c1c08b2
Jul 16 16:35:13.316533 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:13.316471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr" event={"ID":"5778f0dd-c09c-4d21-a1b5-05e61fe9476d","Type":"ContainerStarted","Data":"dd0190f3eb085881d526bebcc2e97c9c13977de0cf7bbc6e1cfb3f958c1c08b2"}
Jul 16 16:35:14.324844 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:14.324756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr" event={"ID":"5778f0dd-c09c-4d21-a1b5-05e61fe9476d","Type":"ContainerStarted","Data":"2ec22e825440705d3a20e080739e91f9281a49fda602b5f7edd8552d45d200e3"}
Jul 16 16:35:14.344524 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:14.344445    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr" podStartSLOduration=1.160454726 podStartE2EDuration="2.344426235s" totalImagesPullingTime="1.183971509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:35:14.343119394 +0000 UTC m=+590.003358797" watchObservedRunningTime="2026-07-16 16:35:14.344426235 +0000 UTC m=+590.004665664"
Jul 16 16:35:17.981970 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:17.981934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:18.895805 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:18.895764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:35:22.538315 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:22.538276    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:22.538761 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:22.538366    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:22.551013 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:22.550986    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:23.376901 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:23.376865    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr"
Jul 16 16:35:25.293275 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:25.293231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:27.059513 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:27.059463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:28.394636 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:28.394604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:35:32.061895 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:32.061859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:33.992989 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:33.992951    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:35:47.343068 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.342978    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"]
Jul 16 16:35:47.348696 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.348664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.351780 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.351753    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 16:35:47.360236 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.360212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"]
Jul 16 16:35:47.388883 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.388845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:47.432595 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.432548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.432799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.432599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.432799 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.432685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.432895 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.432845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.432940 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.432893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9sqk\" (UniqueName: \"kubernetes.io/projected/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-kube-api-access-n9sqk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.432979 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.432940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.533803 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.533766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.533803 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.533803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534052 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.533928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534110 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.534084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.534112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9sqk\" (UniqueName: \"kubernetes.io/projected/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-kube-api-access-n9sqk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534163 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.534146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534261 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.534170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534261 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.534251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.534416 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.534401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.536463 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.536437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.536640 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.536628    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.543667 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.543644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9sqk\" (UniqueName: \"kubernetes.io/projected/6b56f61d-3504-4c7a-9749-b92b0fee2fd4-kube-api-access-n9sqk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-g59lf\" (UID: \"6b56f61d-3504-4c7a-9749-b92b0fee2fd4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.658959 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.658923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:47.801524 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.801378    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"]
Jul 16 16:35:47.804300 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:35:47.804264    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b56f61d_3504_4c7a_9749_b92b0fee2fd4.slice/crio-d646e72856d359eb98534574cbb6c4f6c902032e09ad19d8508da99c9e96de80 WatchSource:0}: Error finding container d646e72856d359eb98534574cbb6c4f6c902032e09ad19d8508da99c9e96de80: Status 404 returned error can't find the container with id d646e72856d359eb98534574cbb6c4f6c902032e09ad19d8508da99c9e96de80
Jul 16 16:35:47.805614 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:47.805597    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 16:35:48.475062 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:48.475027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf" event={"ID":"6b56f61d-3504-4c7a-9749-b92b0fee2fd4","Type":"ContainerStarted","Data":"e758597fc823dc093ca679ec9f1fdbdcb2d796361656288e68c934a0b79f0c0b"}
Jul 16 16:35:48.475469 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:48.475079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf" event={"ID":"6b56f61d-3504-4c7a-9749-b92b0fee2fd4","Type":"ContainerStarted","Data":"d646e72856d359eb98534574cbb6c4f6c902032e09ad19d8508da99c9e96de80"}
Jul 16 16:35:48.495917 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:48.495865    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf" podStartSLOduration=1.27958451 podStartE2EDuration="1.495849801s" totalImagesPullingTime="216.265291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:35:48.49520353 +0000 UTC m=+624.155442957" watchObservedRunningTime="2026-07-16 16:35:48.495849801 +0000 UTC m=+624.156089249"
Jul 16 16:35:49.585234 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:49.585200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:35:53.809675 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:53.809636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:35:57.098471 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:57.098433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:35:57.660111 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:57.660070    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:57.660329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:57.660144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:57.672539 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:57.672474    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:35:58.531169 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:35:58.531141    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-g59lf"
Jul 16 16:36:00.409098 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:00.409061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:10.123235 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:10.123197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:10.219725 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:10.219690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:15.434284 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:15.434241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:15.497166 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:15.497136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:35.727068 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:35.727027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:35.879407 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:35.879372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:37.108099 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:37.108058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:37.208094 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:37.208053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:36:52.631767 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:36:52.631728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:37:07.405614 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:07.405579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:37:16.886188 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:16.886106    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:37:27.501660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:27.501627    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:37:37.799129 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:37.799092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:37:48.790001 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:48.789968    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:37:50.499753 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:50.499720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:37:52.268232 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:37:52.268197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:17.009379 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:17.009342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:38:28.588760 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:28.588721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:38:33.656989 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:33.656953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:33.755011 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:33.754977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:33.903440 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:33.903399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:40.335119 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:40.335074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:40.441432 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:40.441396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:40.541645 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:40.541612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:40.719280 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:40.719251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:46.454084 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:46.454002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:46.518865 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:46.518836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:38:57.406444 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:38:57.406413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:39:05.703860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:05.703819    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:39:09.736140 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:09.736099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:39:09.838316 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:09.838282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:39:13.632110 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:13.632071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:39:24.695711 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:24.695676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:39:32.620502 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:32.620448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:39:42.099877 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:42.099831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:39:54.000563 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:39:54.000523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:40:05.301660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:40:05.301620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:40:15.344996 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:40:15.344957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:40:40.703873 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:40:40.703788    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:40:51.709348 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:40:51.709305    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:41:15.401855 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:41:15.401811    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:41:25.901166 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:41:25.901127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:41:40.997411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:41:40.997371    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:41:50.604020 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:41:50.603939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:42:00.604764 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:42:00.604722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:42:09.888505 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:42:09.888452    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:42:19.196232 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:42:19.196192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:42:40.145155 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:42:40.145124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:44:09.736328 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:09.736282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:44:15.298505 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:15.298451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:44:21.305660 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:21.305618    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:44:26.223613 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:26.223568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:44:26.322142 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:26.322096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:44:33.805461 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:33.805423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:44:45.407377 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:45.407335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:44:56.730424 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:44:56.730387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:45:07.643726 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:07.643688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:45:16.809818 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:16.809781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:45:26.294227 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:26.294186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:45:28.981927 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:28.981877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:45:29.088895 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:29.088790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:45:38.099336 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:38.099298    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:45:47.495716 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:47.495680    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:45:59.096797 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:45:59.096758    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:46:24.712749 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:46:24.712658    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:46:32.396069 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:46:32.396034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:46:42.504951 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:46:42.504913    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:46:52.214106 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:46:52.214073    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:47:01.832215 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:47:01.832179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:47:13.198407 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:47:13.198365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:47:22.609975 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:47:22.609936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:47:32.693593 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:47:32.693555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:47:42.498119 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:47:42.498083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:47:52.096209 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:47:52.096129    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:48:01.411591 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:48:01.411557    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:48:15.059086 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:48:15.059031    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:48:24.601068 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:48:24.601030    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:48:34.297847 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:48:34.297806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:48:47.405175 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:48:47.405139    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:48:58.598625 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:48:58.598587    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:49:07.804972 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:49:07.804931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:49:20.326209 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:49:20.326127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:49:33.205238 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:49:33.205207    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:49:46.996671 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:49:46.996634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:49:48.753684 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:49:48.753579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:49:56.929515 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:49:56.929437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:00.204961 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:00.204927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:50:04.440395 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:04.440363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:09.550446 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:09.550405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:09.647379 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:09.647334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:12.594177 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:12.594113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:12.697501 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:12.697460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:13.065947 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:13.065918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:15.504468 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:15.504437    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:50:18.878787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:18.878749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:18.942542 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:18.942475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:19.120528 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:19.120473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:19.222578 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:19.222455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:20.311520 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:20.311446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:20.412107 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:20.412054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:20.544393 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:20.544360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:21.022167 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:21.022121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:21.152116 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:21.152076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:21.252147 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:21.252106    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:23.072982 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:23.072947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:50:27.603956 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:27.603916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:50:40.056948 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:50:40.056916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:36.118546 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:36.118478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:39.195285 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:39.195254    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:51:40.519880 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:40.519844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:46.814050 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:46.813997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:47.000814 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:47.000774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:50.832997 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:50.832957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:51.199252 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:51.199215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:51.371284 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:51.371238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:51.523583 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:51.523499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:52.714046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:52.714002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:52.852931 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:52.852898    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:55.191199 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:55.191165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:55.293913 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:55.293879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:51:59.695046 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:51:59.695012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:52:07.904914 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:52:07.904875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:52:08.006171 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:52:08.006130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:52:11.191223 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:52:11.191193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:52:57.338008 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:52:57.337965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:52:57.473466 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:52:57.473409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:52:57.939255 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:52:57.939222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:00.297741 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:00.297706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:53:03.819692 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:03.819660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:03.958736 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:03.958705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:04.063739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:04.063660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:05.449384 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:05.449348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:05.553450 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:05.553410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:05.653530 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:05.653498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:05.792945 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:05.792864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:06.394136 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:06.394101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:06.517218 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:06.517186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:07.697434 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:07.697401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:12.497190 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:12.497151    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:53:16.340876 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:16.340845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:16.441776 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:16.441744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:27.333610 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:27.333575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:53:27.450610 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:53:27.450576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:21.194229 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:21.194194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:24.091952 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:24.091916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:54:25.609803 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:25.609766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:31.669157 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:31.669119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:31.742822 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:31.742786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:36.750051 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:36.750019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:37.065364 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:37.065328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:38.216150 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:38.216116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:38.304203 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:38.304168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:38.438651 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:38.438615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:38.609892 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:38.609799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:39.124954 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:39.124920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:39.228161 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:39.228125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:46.091025 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:46.090982    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:54:49.023328 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:49.023297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:49.084607 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:49.084573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:53.103869 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:53.103835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:54.816691 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:54.816654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:54:54.916202 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:54:54.916161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:55:53.235236 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:55:53.235199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:55:55.908711 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:55:55.908550    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:55:57.841102 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:55:57.841069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:03.966015 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:03.965975    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:04.072787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:04.072755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:08.035045 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:08.035001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:08.717587 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:08.717556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:08.811727 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:08.811677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:08.922744 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:08.922696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:10.669787 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:10.669738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:14.453742 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:14.453711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:17.602272 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:17.602235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:17.716921 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:17.716881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:17.822195 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:17.822150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:17.920061 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:17.920025    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:18.512094 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:18.512059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:25.454370 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:25.454338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:44.527868 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:44.527836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:50.576760 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:50.576679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:50.795377 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:50.795341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:56:50.893853 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:56:50.893801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:06.812783 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:06.812741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:12.529551 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:12.529510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:12.642711 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:12.642679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:12.730242 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:12.730209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:23.305764 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:23.305729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:24.410129 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:24.410096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:30.000351 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:30.000319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:30.080992 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:30.080953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:30.205388 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:30.205355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:30.304807 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:30.304718    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:30.404675 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:30.404634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:31.282948 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:31.282896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:31.370888 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:31.370851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:31.469104 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:31.469067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:32.503134 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:32.503095    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:57:33.292141 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:33.292110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:39.245817 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:39.245772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:39.321550 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:39.321514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:40.016965 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:40.016931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:41.601844 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:41.601799    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:57:45.801502 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:45.801443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:45.871582 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:45.871548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:46.085333 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:46.085253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:46.416909 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:46.416875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:46.512842 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:46.512811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:49.725024 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:49.724973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:49.810141 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:49.810102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:49.882525 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:49.882457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:50.098449 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:50.098365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:50.416417 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:50.416382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:50.517438 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:50.517404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:54.281335 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:54.281299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:55.057103 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:55.057059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:55.159936 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:55.159894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:57:55.218208 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:55.218170    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:57:55.504162 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:57:55.504123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:01.489463 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:01.489427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:01.589802 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:01.589770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:12.554539 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:12.554461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:15.399771 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:15.399738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:58:17.001143 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:17.001110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:17.261747 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:17.261639    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:17.526329 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:17.526230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:22.933407 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:22.933358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:23.033819 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:23.033782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:27.747938 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:27.747899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:27.995300 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:27.995264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:28.132456 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:28.132420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:28.225376 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:28.225342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:28.364317 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:28.364287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:34.318921 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:34.318885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:34.441690 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:34.441656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:34.565895 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:34.565859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:34.724726 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:34.724692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:40.689155 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:40.689117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:40.788860 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:40.788831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:45.512363 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:45.512327    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:47.735739 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:47.735702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:48.181523 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:48.181473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:48.471102 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:48.471020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:51.097411 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:51.097375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:51.200561 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:51.200530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:51.298239 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:51.298210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:51.372591 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:51.372563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:51.817965 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:51.817882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:51.918232 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:51.918202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:55.588317 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:55.588279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:58:57.598677 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:58:57.598642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:59:12.018948 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.018916    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"]
Jul 16 16:59:12.026028 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.026005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.029691 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.029669    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-187946be\"/\"openshift-service-ca.crt\""
Jul 16 16:59:12.029808 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.029724    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-187946be\"/\"e2e-lifecycle-model-187946be-kserve-self-signed-certs\""
Jul 16 16:59:12.029808 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.029674    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-187946be\"/\"kube-root-ca.crt\""
Jul 16 16:59:12.029921 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.029850    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-187946be\"/\"default-dockercfg-rjswr\""
Jul 16 16:59:12.034294 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"]
Jul 16 16:59:12.034603 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-model-cache\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.034657 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tmp-dir\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.034657 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tls-certs\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.034742 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tt86\" (UniqueName: \"kubernetes.io/projected/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-kube-api-access-5tt86\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.034778 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-home\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.034811 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.034788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-dshm\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.057270 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.057243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:59:12.135518 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-model-cache\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135642 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tmp-dir\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135642 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tls-certs\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135642 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tt86\" (UniqueName: \"kubernetes.io/projected/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-kube-api-access-5tt86\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135642 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-home\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135850 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-dshm\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135940 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-model-cache\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.135999 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.135935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tmp-dir\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.136105 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.136088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-home\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.138059 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.138036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-dshm\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.138257 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.138241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tls-certs\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.145421 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.145402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tt86\" (UniqueName: \"kubernetes.io/projected/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-kube-api-access-5tt86\") pod \"e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") " pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.336708 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.336618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:12.470005 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.469976    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"]
Jul 16 16:59:12.472854 ip-10-0-128-205 kubenswrapper[2564]: W0716 16:59:12.472825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d7a5fc8_3e9f_4b08_95c0_c4a9f3d44210.slice/crio-3fd04d362b2f392fc3fcf3dc7326f484054d80608baf7b1b35fa5f8e2d16d912 WatchSource:0}: Error finding container 3fd04d362b2f392fc3fcf3dc7326f484054d80608baf7b1b35fa5f8e2d16d912: Status 404 returned error can't find the container with id 3fd04d362b2f392fc3fcf3dc7326f484054d80608baf7b1b35fa5f8e2d16d912
Jul 16 16:59:12.769181 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.769142    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9" event={"ID":"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210","Type":"ContainerStarted","Data":"58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98"}
Jul 16 16:59:12.769181 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.769187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9" event={"ID":"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210","Type":"ContainerStarted","Data":"3fd04d362b2f392fc3fcf3dc7326f484054d80608baf7b1b35fa5f8e2d16d912"}
Jul 16 16:59:12.787632 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:12.787583    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9" podStartSLOduration=1.787568131 podStartE2EDuration="1.787568131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:59:12.786520886 +0000 UTC m=+2028.446760292" watchObservedRunningTime="2026-07-16 16:59:12.787568131 +0000 UTC m=+2028.447807592"
Jul 16 16:59:14.833767 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:14.833733    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:59:22.337180 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:22.337143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:22.337631 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:22.337204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:22.350028 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:22.350000    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:22.824152 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:22.824125    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 16:59:33.194264 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:33.194228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:59:49.834175 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:49.834078    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:59:53.593766 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:53.593735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 16:59:54.431210 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:54.431174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 16:59:59.409902 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:59.409870    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"]
Jul 16 16:59:59.505843 ip-10-0-128-205 kubenswrapper[2564]: I0716 16:59:59.505810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:07.994822 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:07.994792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:08.061285 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:08.061252    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:14.431179 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.431136    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9" podUID="7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" containerName="main" containerID="cri-o://58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98" gracePeriod=45
Jul 16 17:00:14.679379 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.679353    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 17:00:14.769109 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769025    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-model-cache\") pod \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") "
Jul 16 17:00:14.769109 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769066    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tt86\" (UniqueName: \"kubernetes.io/projected/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-kube-api-access-5tt86\") pod \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") "
Jul 16 17:00:14.769109 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769098    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tmp-dir\") pod \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") "
Jul 16 17:00:14.769377 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tls-certs\") pod \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") "
Jul 16 17:00:14.769377 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769147    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-home\") pod \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") "
Jul 16 17:00:14.769377 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769196    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-dshm\") pod \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\" (UID: \"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210\") "
Jul 16 17:00:14.769555 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769368    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-model-cache" (OuterVolumeSpecName: "model-cache") pod "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" (UID: "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:00:14.769555 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769374    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" (UID: "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:00:14.769555 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.769466    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-home" (OuterVolumeSpecName: "home") pod "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" (UID: "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:00:14.771460 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.771434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-dshm" (OuterVolumeSpecName: "dshm") pod "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" (UID: "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:00:14.771561 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.771459    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-kube-api-access-5tt86" (OuterVolumeSpecName: "kube-api-access-5tt86") pod "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" (UID: "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210"). InnerVolumeSpecName "kube-api-access-5tt86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:00:14.771599 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.771558    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" (UID: "7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:00:14.869859 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.869821    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:00:14.869859 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.869854    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:00:14.870072 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.869866    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:00:14.870072 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.869879    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:00:14.870072 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.869891    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:00:14.870072 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:14.869905    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tt86\" (UniqueName: \"kubernetes.io/projected/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210-kube-api-access-5tt86\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:00:15.048591 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.048469    2564 generic.go:356] "Generic (PLEG): container finished" podID="7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" containerID="58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98" exitCode=0
Jul 16 17:00:15.048591 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.048537    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"
Jul 16 17:00:15.048591 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.048565    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9" event={"ID":"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210","Type":"ContainerDied","Data":"58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98"}
Jul 16 17:00:15.048871 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.048606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9" event={"ID":"7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210","Type":"ContainerDied","Data":"3fd04d362b2f392fc3fcf3dc7326f484054d80608baf7b1b35fa5f8e2d16d912"}
Jul 16 17:00:15.048871 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.048628    2564 scope.go:117] "RemoveContainer" containerID="58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98"
Jul 16 17:00:15.056860 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.056841    2564 scope.go:117] "RemoveContainer" containerID="58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98"
Jul 16 17:00:15.057122 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:00:15.057100    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98\": container with ID starting with 58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98 not found: ID does not exist" containerID="58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98"
Jul 16 17:00:15.057172 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.057131    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98"} err="failed to get container status \"58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98\": rpc error: code = NotFound desc = could not find container \"58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98\": container with ID starting with 58f21d2a04f785403a11b33041f53a8c01724f61c50cd036b676bd723588ea98 not found: ID does not exist"
Jul 16 17:00:15.067792 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.067768    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"]
Jul 16 17:00:15.071532 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:15.071511    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-187946be/e2e-lifecycle-model-187946be-kserve-8d95864c-kbpr9"]
Jul 16 17:00:16.879033 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:16.878996    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" path="/var/lib/kubelet/pods/7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210/volumes"
Jul 16 17:00:36.061067 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:36.061024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:37.196659 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:37.196617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:42.728057 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:42.728021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:42.830328 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:42.830295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:46.861400 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:46.861359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:47.137150 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:47.137114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:48.317090 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:48.317056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:48.412043 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:48.412008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:48.516047 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:48.516016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:49.328800 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:49.328764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:49.421950 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:49.421916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:50.935720 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:50.935686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:51.199610 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:51.199533    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:00:55.186794 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:55.186757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:57.078677 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:57.078644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:57.146829 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:57.146796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:00:57.797279 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:00:57.797245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:03.519353 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:03.519317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:03.631048 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:03.631008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:03.722904 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:03.722868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:05.298703 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:05.298666    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:01:14.301982 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:14.301942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:14.665382 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:14.665347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:35.732383 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:35.732294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:41.996321 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:41.996286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:42.086027 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:42.085993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:42.350302 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:42.350215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:42.710476 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:42.710442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:43.263464 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:43.263436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:46.127702 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:46.127665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:46.246741 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:46.246705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:46.351408 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:46.351372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:46.601766 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:46.601678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:46.994432 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:46.994398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:47.100441 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:47.100395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:50.641021 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:50.640989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:50.991351 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:50.991268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:51.381582 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.381543    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"]
Jul 16 17:01:51.381973 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.381955    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" containerName="main"
Jul 16 17:01:51.382060 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.381975    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" containerName="main"
Jul 16 17:01:51.382150 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.382064    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7a5fc8-3e9f-4b08-95c0-c4a9f3d44210" containerName="main"
Jul 16 17:01:51.389723 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.389694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.394654 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.394630    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f37c57-openshift-default-dockercfg-dswt6\""
Jul 16 17:01:51.419357 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.419333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"]
Jul 16 17:01:51.440199 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.440172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:51.494036 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqq7q\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-kube-api-access-tqq7q\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494036 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-socket\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494254 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5956bde5-f237-4619-b41b-69190a76063c-istio-podinfo\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494254 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-istio-token\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494254 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-data\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494254 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5956bde5-f237-4619-b41b-69190a76063c-istiod-ca-cert\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494254 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-certs\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494581 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-envoy\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.494581 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.494367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-credential-socket\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595102 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-envoy\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595102 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-credential-socket\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595342 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqq7q\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-kube-api-access-tqq7q\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595342 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-socket\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595342 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5956bde5-f237-4619-b41b-69190a76063c-istio-podinfo\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595526 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-istio-token\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595526 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-data\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595526 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5956bde5-f237-4619-b41b-69190a76063c-istiod-ca-cert\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595526 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-certs\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595736 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-socket\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.595736 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-credential-socket\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.596019 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-certs\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.596019 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.595928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-data\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.596308 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.596226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5956bde5-f237-4619-b41b-69190a76063c-istiod-ca-cert\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.597667 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.597645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-envoy\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.598109 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.598086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5956bde5-f237-4619-b41b-69190a76063c-istio-podinfo\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.606299 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.606277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqq7q\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-kube-api-access-tqq7q\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.606413 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.606341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-istio-token\") pod \"e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") " pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.700850 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.700772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:51.844355 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.844332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"]
Jul 16 17:01:51.846530 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:01:51.846503    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5956bde5_f237_4619_b41b_69190a76063c.slice/crio-db14b258a5b5d55449802acc4332ae6ad3a5a56a4da3a5bd8a6b651371d64eae WatchSource:0}: Error finding container db14b258a5b5d55449802acc4332ae6ad3a5a56a4da3a5bd8a6b651371d64eae: Status 404 returned error can't find the container with id db14b258a5b5d55449802acc4332ae6ad3a5a56a4da3a5bd8a6b651371d64eae
Jul 16 17:01:51.848654 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.848623    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:01:51.848727 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.848700    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:01:51.848766 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:51.848728    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:01:52.496273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:52.496240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" event={"ID":"5956bde5-f237-4619-b41b-69190a76063c","Type":"ContainerStarted","Data":"281971b847317eff8569b23e60b89a28943c099412a88a549674149dfb200541"}
Jul 16 17:01:52.496452 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:52.496293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" event={"ID":"5956bde5-f237-4619-b41b-69190a76063c","Type":"ContainerStarted","Data":"db14b258a5b5d55449802acc4332ae6ad3a5a56a4da3a5bd8a6b651371d64eae"}
Jul 16 17:01:52.533590 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:52.533544    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podStartSLOduration=1.533528516 podStartE2EDuration="1.533528516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:01:52.532206398 +0000 UTC m=+2188.192445833" watchObservedRunningTime="2026-07-16 17:01:52.533528516 +0000 UTC m=+2188.193767997"
Jul 16 17:01:52.701423 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:52.701395    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:52.706085 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:52.706057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:53.500473 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:53.500443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:53.501291 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:53.501273    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:01:53.617674 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:53.617648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:01:54.880903 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:54.880870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:55.040633 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:55.040604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:55.162708 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:55.162636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:55.625436 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:55.625402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:55.800441 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:55.800405    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:01:59.102050 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:01:59.102016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:08.493462 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:08.493413    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:02:08.958281 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:08.958253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:09.060183 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:09.060151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:09.542645 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:09.542601    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 17:02:09.543034 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:09.542669    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 17:02:10.585937 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:10.585846    2564 generic.go:356] "Generic (PLEG): container finished" podID="5956bde5-f237-4619-b41b-69190a76063c" containerID="281971b847317eff8569b23e60b89a28943c099412a88a549674149dfb200541" exitCode=0
Jul 16 17:02:10.585937 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:10.585902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" event={"ID":"5956bde5-f237-4619-b41b-69190a76063c","Type":"ContainerDied","Data":"281971b847317eff8569b23e60b89a28943c099412a88a549674149dfb200541"}
Jul 16 17:02:10.586478 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:10.586431    2564 scope.go:117] "RemoveContainer" containerID="281971b847317eff8569b23e60b89a28943c099412a88a549674149dfb200541"
Jul 16 17:02:10.587461 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:10.587431    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:02:10.587588 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:10.587518    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:02:10.587588 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:10.587551    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:02:11.596088 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:11.596044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" event={"ID":"5956bde5-f237-4619-b41b-69190a76063c","Type":"ContainerStarted","Data":"544a6240dfbcf3627402d14a87c78b05c4a6f9d050f1d52e5d0e82ccc7f9b095"}
Jul 16 17:02:11.701338 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:11.701285    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:02:11.701551 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:11.701475    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 17:02:11.701616 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:11.701560    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 17:02:12.701393 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:12.701362    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 17:02:12.701803 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:12.701410    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 17:02:13.701980 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:13.701943    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 17:02:13.702383 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:13.702010    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 17:02:14.701325 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:14.701290    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 17:02:14.701685 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:14.701354    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 17:02:15.705553 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:15.705517    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:02:15.705979 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:15.705842    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:02:15.706414 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:15.706398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:02:17.584107 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:17.584072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:17.684269 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:17.684229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:42.441179 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.441144    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"]
Jul 16 17:02:42.443921 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.443899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.446680 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.446660    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fa0ccd\"/\"test-model-fa0ccd-kserve-self-signed-certs\""
Jul 16 17:02:42.447635 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.447604    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fa0ccd\"/\"kube-root-ca.crt\""
Jul 16 17:02:42.447839 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.447794    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fa0ccd\"/\"openshift-service-ca.crt\""
Jul 16 17:02:42.447926 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.447887    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fa0ccd\"/\"default-dockercfg-nlcqc\""
Jul 16 17:02:42.455756 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.455735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"]
Jul 16 17:02:42.474431 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.474398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:42.548188 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.548156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-home\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.548376 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.548197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-model-cache\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.548376 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.548223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tls-certs\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.548376 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.548321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tmp-dir\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.548376 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.548357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgtnt\" (UniqueName: \"kubernetes.io/projected/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-kube-api-access-fgtnt\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.548590 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.548422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-dshm\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649060 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-home\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649060 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-model-cache\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649317 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tls-certs\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649317 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tmp-dir\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649317 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgtnt\" (UniqueName: \"kubernetes.io/projected/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-kube-api-access-fgtnt\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649317 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-dshm\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649576 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-home\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649576 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tmp-dir\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.649663 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.649596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-model-cache\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.651581 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.651559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-dshm\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.651795 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.651779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tls-certs\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.657452 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.657430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgtnt\" (UniqueName: \"kubernetes.io/projected/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-kube-api-access-fgtnt\") pod \"test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") " pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.753038 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.752969    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:42.889503 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:42.889457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"]
Jul 16 17:02:42.891685 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:02:42.891659    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1abef9c_1e5a_42bd_8865_9c867a3ca4d0.slice/crio-8d0b2673baeeee1cc69a9051a873290a3cfa6e5d7d4c38a0fd9554021e913c82 WatchSource:0}: Error finding container 8d0b2673baeeee1cc69a9051a873290a3cfa6e5d7d4c38a0fd9554021e913c82: Status 404 returned error can't find the container with id 8d0b2673baeeee1cc69a9051a873290a3cfa6e5d7d4c38a0fd9554021e913c82
Jul 16 17:02:43.737866 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:43.737832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn" event={"ID":"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0","Type":"ContainerStarted","Data":"8b17cf2b9dd81ed786ddf8a7e5c3c67109d6c214a036a8906625928f404f4f4b"}
Jul 16 17:02:43.738239 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:43.737873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn" event={"ID":"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0","Type":"ContainerStarted","Data":"8d0b2673baeeee1cc69a9051a873290a3cfa6e5d7d4c38a0fd9554021e913c82"}
Jul 16 17:02:43.763512 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:43.761340    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn" podStartSLOduration=1.7613212950000001 podStartE2EDuration="1.761321295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:02:43.757225349 +0000 UTC m=+2239.417464755" watchObservedRunningTime="2026-07-16 17:02:43.761321295 +0000 UTC m=+2239.421560700"
Jul 16 17:02:45.995408 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:45.995329    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:02:48.998524 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:48.998468    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:49.099169 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:49.099130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:02:52.753867 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:52.753835    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:52.753867 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:52.753878    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:52.766062 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:52.766040    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:52.787924 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:52.787900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:02:56.689871 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:02:56.689795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:03:08.840975 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.840942    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"]
Jul 16 17:03:08.844244 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.844219    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:08.848031 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.848010    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f37c57\"/\"kube-root-ca.crt\""
Jul 16 17:03:08.848578 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.848280    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f37c57\"/\"test-model-f37c57-kserve-self-signed-certs\""
Jul 16 17:03:08.849386 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.848327    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f37c57\"/\"default-dockercfg-97bp2\""
Jul 16 17:03:08.849386 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.848382    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f37c57\"/\"openshift-service-ca.crt\""
Jul 16 17:03:08.858794 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.858772    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"]
Jul 16 17:03:08.890712 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.890687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:08.976823 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.976793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht64r\" (UniqueName: \"kubernetes.io/projected/5c54af48-e012-4ff9-8131-7d91578d3bf7-kube-api-access-ht64r\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:08.977002 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.976845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-tmp-dir\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:08.977002 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.976902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-home\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:08.977136 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.977025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-dshm\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:08.977136 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.977104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c54af48-e012-4ff9-8131-7d91578d3bf7-tls-certs\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:08.977136 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:08.977132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-model-cache\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078175 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-tmp-dir\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-home\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-dshm\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c54af48-e012-4ff9-8131-7d91578d3bf7-tls-certs\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-model-cache\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht64r\" (UniqueName: \"kubernetes.io/projected/5c54af48-e012-4ff9-8131-7d91578d3bf7-kube-api-access-ht64r\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078660 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-tmp-dir\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078660 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078628    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-home\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.078767 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.078714    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-model-cache\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.080639 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.080617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-dshm\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.080943 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.080925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c54af48-e012-4ff9-8131-7d91578d3bf7-tls-certs\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.101509 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.101432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht64r\" (UniqueName: \"kubernetes.io/projected/5c54af48-e012-4ff9-8131-7d91578d3bf7-kube-api-access-ht64r\") pod \"test-model-f37c57-kserve-84fb679b75-gpk8v\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") " pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.156131 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.156100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:09.291275 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.291248    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"]
Jul 16 17:03:09.292821 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:03:09.292790    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c54af48_e012_4ff9_8131_7d91578d3bf7.slice/crio-58a2a4f4462833073bfb0a922c20ab2c5be6cbe1bcc010f1faa345eea27ee4cd WatchSource:0}: Error finding container 58a2a4f4462833073bfb0a922c20ab2c5be6cbe1bcc010f1faa345eea27ee4cd: Status 404 returned error can't find the container with id 58a2a4f4462833073bfb0a922c20ab2c5be6cbe1bcc010f1faa345eea27ee4cd
Jul 16 17:03:09.857268 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.857230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v" event={"ID":"5c54af48-e012-4ff9-8131-7d91578d3bf7","Type":"ContainerStarted","Data":"dba5647e61a682ee49d19571ccdf62c5a19bf5c886656e2105791dbfeb6bc5f0"}
Jul 16 17:03:09.857268 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.857269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v" event={"ID":"5c54af48-e012-4ff9-8131-7d91578d3bf7","Type":"ContainerStarted","Data":"58a2a4f4462833073bfb0a922c20ab2c5be6cbe1bcc010f1faa345eea27ee4cd"}
Jul 16 17:03:09.875288 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:09.875233    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v" podStartSLOduration=1.875219864 podStartE2EDuration="1.875219864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:03:09.873035008 +0000 UTC m=+2265.533274413" watchObservedRunningTime="2026-07-16 17:03:09.875219864 +0000 UTC m=+2265.535459285"
Jul 16 17:03:13.290802 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:13.290764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:03:18.084404 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:18.084371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:18.191153 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:18.191118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:19.156585 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:19.156552    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:19.156991 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:19.156621    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:19.169209 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:19.169184    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:19.915927 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:19.915894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:26.796194 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:26.796158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:03:28.812980 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:28.812944    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"]
Jul 16 17:03:28.848400 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:28.848360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:29.768028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:29.767997    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"]
Jul 16 17:03:29.796220 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:29.796183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:30.613003 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:30.612973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:31.398265 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:31.398228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:39.993741 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:39.993713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:03:40.454849 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:40.454814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:43.833815 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:43.833752    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn" podUID="b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" containerName="main" containerID="cri-o://8b17cf2b9dd81ed786ddf8a7e5c3c67109d6c214a036a8906625928f404f4f4b" gracePeriod=45
Jul 16 17:03:44.017400 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.017368    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" containerID="8b17cf2b9dd81ed786ddf8a7e5c3c67109d6c214a036a8906625928f404f4f4b" exitCode=0
Jul 16 17:03:44.017560 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.017447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn" event={"ID":"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0","Type":"ContainerDied","Data":"8b17cf2b9dd81ed786ddf8a7e5c3c67109d6c214a036a8906625928f404f4f4b"}
Jul 16 17:03:44.079330 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.079307    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:03:44.189775 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.189744    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-model-cache\") pod \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") "
Jul 16 17:03:44.189966 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.189782    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-dshm\") pod \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") "
Jul 16 17:03:44.189966 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.189808    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgtnt\" (UniqueName: \"kubernetes.io/projected/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-kube-api-access-fgtnt\") pod \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") "
Jul 16 17:03:44.189966 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.189833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tmp-dir\") pod \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") "
Jul 16 17:03:44.189966 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.189859    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-home\") pod \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") "
Jul 16 17:03:44.189966 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.189881    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tls-certs\") pod \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\" (UID: \"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0\") "
Jul 16 17:03:44.190203 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.190056    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" (UID: "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:44.190203 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.190072    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" (UID: "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:44.190203 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.190169    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-home" (OuterVolumeSpecName: "home") pod "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" (UID: "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:44.192178 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.192158    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-dshm" (OuterVolumeSpecName: "dshm") pod "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" (UID: "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:44.192178 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.192172    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-kube-api-access-fgtnt" (OuterVolumeSpecName: "kube-api-access-fgtnt") pod "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" (UID: "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0"). InnerVolumeSpecName "kube-api-access-fgtnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:03:44.192285 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.192243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" (UID: "b1abef9c-1e5a-42bd-8865-9c867a3ca4d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:03:44.291016 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.290987    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:44.291016 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.291010    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgtnt\" (UniqueName: \"kubernetes.io/projected/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-kube-api-access-fgtnt\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:44.291016 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.291020    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:44.291215 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.291028    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:44.291215 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.291036    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:44.291215 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.291044    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:44.789823 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:44.789761    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v" podUID="5c54af48-e012-4ff9-8131-7d91578d3bf7" containerName="main" containerID="cri-o://dba5647e61a682ee49d19571ccdf62c5a19bf5c886656e2105791dbfeb6bc5f0" gracePeriod=45
Jul 16 17:03:45.023949 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.023914    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c54af48-e012-4ff9-8131-7d91578d3bf7" containerID="dba5647e61a682ee49d19571ccdf62c5a19bf5c886656e2105791dbfeb6bc5f0" exitCode=0
Jul 16 17:03:45.023949 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.023941    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v" event={"ID":"5c54af48-e012-4ff9-8131-7d91578d3bf7","Type":"ContainerDied","Data":"dba5647e61a682ee49d19571ccdf62c5a19bf5c886656e2105791dbfeb6bc5f0"}
Jul 16 17:03:45.025354 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.025331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn" event={"ID":"b1abef9c-1e5a-42bd-8865-9c867a3ca4d0","Type":"ContainerDied","Data":"8d0b2673baeeee1cc69a9051a873290a3cfa6e5d7d4c38a0fd9554021e913c82"}
Jul 16 17:03:45.025473 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.025364    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"
Jul 16 17:03:45.025473 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.025373    2564 scope.go:117] "RemoveContainer" containerID="8b17cf2b9dd81ed786ddf8a7e5c3c67109d6c214a036a8906625928f404f4f4b"
Jul 16 17:03:45.045108 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.045086    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"]
Jul 16 17:03:45.050913 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.050888    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fa0ccd/test-model-fa0ccd-kserve-5d58cbd8dc-mfrrn"]
Jul 16 17:03:45.054091 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.054066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:45.065907 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.065891    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:45.197725 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.197692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-home\") pod \"5c54af48-e012-4ff9-8131-7d91578d3bf7\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") "
Jul 16 17:03:45.197725 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.197726    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c54af48-e012-4ff9-8131-7d91578d3bf7-tls-certs\") pod \"5c54af48-e012-4ff9-8131-7d91578d3bf7\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") "
Jul 16 17:03:45.197976 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.197784    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-tmp-dir\") pod \"5c54af48-e012-4ff9-8131-7d91578d3bf7\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") "
Jul 16 17:03:45.197976 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.197832    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht64r\" (UniqueName: \"kubernetes.io/projected/5c54af48-e012-4ff9-8131-7d91578d3bf7-kube-api-access-ht64r\") pod \"5c54af48-e012-4ff9-8131-7d91578d3bf7\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") "
Jul 16 17:03:45.197976 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.197874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-dshm\") pod \"5c54af48-e012-4ff9-8131-7d91578d3bf7\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") "
Jul 16 17:03:45.197976 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.197891    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-model-cache\") pod \"5c54af48-e012-4ff9-8131-7d91578d3bf7\" (UID: \"5c54af48-e012-4ff9-8131-7d91578d3bf7\") "
Jul 16 17:03:45.198166 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.198030    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-home" (OuterVolumeSpecName: "home") pod "5c54af48-e012-4ff9-8131-7d91578d3bf7" (UID: "5c54af48-e012-4ff9-8131-7d91578d3bf7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:45.198166 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.198110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c54af48-e012-4ff9-8131-7d91578d3bf7" (UID: "5c54af48-e012-4ff9-8131-7d91578d3bf7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:45.198166 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.198126    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:45.198300 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.198257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c54af48-e012-4ff9-8131-7d91578d3bf7" (UID: "5c54af48-e012-4ff9-8131-7d91578d3bf7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:45.200273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.200242    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c54af48-e012-4ff9-8131-7d91578d3bf7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c54af48-e012-4ff9-8131-7d91578d3bf7" (UID: "5c54af48-e012-4ff9-8131-7d91578d3bf7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:03:45.200389 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.200290    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-dshm" (OuterVolumeSpecName: "dshm") pod "5c54af48-e012-4ff9-8131-7d91578d3bf7" (UID: "5c54af48-e012-4ff9-8131-7d91578d3bf7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:03:45.200389 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.200293    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c54af48-e012-4ff9-8131-7d91578d3bf7-kube-api-access-ht64r" (OuterVolumeSpecName: "kube-api-access-ht64r") pod "5c54af48-e012-4ff9-8131-7d91578d3bf7" (UID: "5c54af48-e012-4ff9-8131-7d91578d3bf7"). InnerVolumeSpecName "kube-api-access-ht64r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:03:45.298610 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.298522    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:45.298610 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.298554    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht64r\" (UniqueName: \"kubernetes.io/projected/5c54af48-e012-4ff9-8131-7d91578d3bf7-kube-api-access-ht64r\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:45.298610 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.298565    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:45.298610 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.298574    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c54af48-e012-4ff9-8131-7d91578d3bf7-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:45.298610 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:45.298584    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c54af48-e012-4ff9-8131-7d91578d3bf7-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:03:46.031595 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.031557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v" event={"ID":"5c54af48-e012-4ff9-8131-7d91578d3bf7","Type":"ContainerDied","Data":"58a2a4f4462833073bfb0a922c20ab2c5be6cbe1bcc010f1faa345eea27ee4cd"}
Jul 16 17:03:46.031595 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.031605    2564 scope.go:117] "RemoveContainer" containerID="dba5647e61a682ee49d19571ccdf62c5a19bf5c886656e2105791dbfeb6bc5f0"
Jul 16 17:03:46.032063 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.031566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"
Jul 16 17:03:46.052682 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.052647    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"]
Jul 16 17:03:46.058388 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.058367    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f37c57/test-model-f37c57-kserve-84fb679b75-gpk8v"]
Jul 16 17:03:46.875225 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.875194    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c54af48-e012-4ff9-8131-7d91578d3bf7" path="/var/lib/kubelet/pods/5c54af48-e012-4ff9-8131-7d91578d3bf7/volumes"
Jul 16 17:03:46.875622 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:46.875608    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" path="/var/lib/kubelet/pods/b1abef9c-1e5a-42bd-8865-9c867a3ca4d0/volumes"
Jul 16 17:03:49.493517 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:49.493467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:03:51.000880 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:51.000823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:51.068328 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:51.068297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:55.795295 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:55.795260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:56.048856 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:56.048768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:56.804240 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:56.804154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:03:56.906465 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:03:56.906425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:01.088156 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:01.088117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:06.701896 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:06.701864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:09.993730 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:09.993695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:04:11.293886 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:11.293846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:11.372921 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:11.372879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:17.244531 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:17.244442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:17.345756 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:17.345701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:22.064053 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:22.064018    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"]
Jul 16 17:04:22.064516 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:22.064226    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy" containerID="cri-o://544a6240dfbcf3627402d14a87c78b05c4a6f9d050f1d52e5d0e82ccc7f9b095" gracePeriod=30
Jul 16 17:04:22.088391 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:22.088357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:22.362058 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:22.361968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:22.739443 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:22.739408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:23.482689 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:23.482657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:23.579649 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:23.579618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:25.981775 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:25.981728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:26.077169 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:26.077125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:26.288016 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:26.287889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:26.607818 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:26.607716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:26.845078 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:26.845035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:26.940663 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:26.940625    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:27.244508 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.244449    2564 generic.go:356] "Generic (PLEG): container finished" podID="5956bde5-f237-4619-b41b-69190a76063c" containerID="544a6240dfbcf3627402d14a87c78b05c4a6f9d050f1d52e5d0e82ccc7f9b095" exitCode=0
Jul 16 17:04:27.244937 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.244528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" event={"ID":"5956bde5-f237-4619-b41b-69190a76063c","Type":"ContainerDied","Data":"544a6240dfbcf3627402d14a87c78b05c4a6f9d050f1d52e5d0e82ccc7f9b095"}
Jul 16 17:04:27.244937 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.244606    2564 scope.go:117] "RemoveContainer" containerID="281971b847317eff8569b23e60b89a28943c099412a88a549674149dfb200541"
Jul 16 17:04:27.329915 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.329892    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:04:27.342038 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342010    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-socket\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342173 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342053    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-data\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342173 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-envoy\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342173 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342141    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-certs\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342173 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342168    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-credential-socket\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342387 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342209    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-istio-token\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342387 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342235    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5956bde5-f237-4619-b41b-69190a76063c-istiod-ca-cert\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342387 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqq7q\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-kube-api-access-tqq7q\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342387 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5956bde5-f237-4619-b41b-69190a76063c-istio-podinfo\") pod \"5956bde5-f237-4619-b41b-69190a76063c\" (UID: \"5956bde5-f237-4619-b41b-69190a76063c\") "
Jul 16 17:04:27.342387 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342334    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:04:27.342641 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342624    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-socket\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.342753 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342722    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:04:27.343030 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.342978    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:04:27.343030 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.343011    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-data" (OuterVolumeSpecName: "istio-data") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:04:27.343538 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.343477    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5956bde5-f237-4619-b41b-69190a76063c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:04:27.344959 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.344923    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:04:27.345079 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.344981    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5956bde5-f237-4619-b41b-69190a76063c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 17:04:27.345276 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.345248    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-istio-token" (OuterVolumeSpecName: "istio-token") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:04:27.345422 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.345401    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-kube-api-access-tqq7q" (OuterVolumeSpecName: "kube-api-access-tqq7q") pod "5956bde5-f237-4619-b41b-69190a76063c" (UID: "5956bde5-f237-4619-b41b-69190a76063c"). InnerVolumeSpecName "kube-api-access-tqq7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:04:27.443979 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.443950    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-data\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.443979 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.443976    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-istio-envoy\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.443979 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.443986    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-workload-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.444219 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.443997    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5956bde5-f237-4619-b41b-69190a76063c-credential-socket\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.444219 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.444006    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-istio-token\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.444219 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.444014    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5956bde5-f237-4619-b41b-69190a76063c-istiod-ca-cert\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.444219 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.444022    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqq7q\" (UniqueName: \"kubernetes.io/projected/5956bde5-f237-4619-b41b-69190a76063c-kube-api-access-tqq7q\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:27.444219 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:27.444029    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5956bde5-f237-4619-b41b-69190a76063c-istio-podinfo\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:04:28.249983 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:28.249955    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"
Jul 16 17:04:28.250450 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:28.249954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v" event={"ID":"5956bde5-f237-4619-b41b-69190a76063c","Type":"ContainerDied","Data":"db14b258a5b5d55449802acc4332ae6ad3a5a56a4da3a5bd8a6b651371d64eae"}
Jul 16 17:04:28.250450 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:28.250089    2564 scope.go:117] "RemoveContainer" containerID="544a6240dfbcf3627402d14a87c78b05c4a6f9d050f1d52e5d0e82ccc7f9b095"
Jul 16 17:04:28.272842 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:28.272812    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"]
Jul 16 17:04:28.279240 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:28.279214    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f37c57-openshift-default-fb46d5c89-n7v7v"]
Jul 16 17:04:28.874908 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:28.874875    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5956bde5-f237-4619-b41b-69190a76063c" path="/var/lib/kubelet/pods/5956bde5-f237-4619-b41b-69190a76063c/volumes"
Jul 16 17:04:30.552152 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:30.552118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:30.718935 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:30.718902    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:04:31.038368 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.038336    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:31.360326 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360243    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"]
Jul 16 17:04:31.360761 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360746    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy"
Jul 16 17:04:31.360820 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360766    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy"
Jul 16 17:04:31.360820 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360790    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy"
Jul 16 17:04:31.360820 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360798    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy"
Jul 16 17:04:31.360820 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360818    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c54af48-e012-4ff9-8131-7d91578d3bf7" containerName="main"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360827    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c54af48-e012-4ff9-8131-7d91578d3bf7" containerName="main"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360844    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" containerName="main"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360853    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" containerName="main"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360925    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1abef9c-1e5a-42bd-8865-9c867a3ca4d0" containerName="main"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360937    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c54af48-e012-4ff9-8131-7d91578d3bf7" containerName="main"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360948    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy"
Jul 16 17:04:31.360961 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.360957    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5956bde5-f237-4619-b41b-69190a76063c" containerName="istio-proxy"
Jul 16 17:04:31.364083 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.364063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.366828 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.366808    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6da193-openshift-default-dockercfg-nt9gg\""
Jul 16 17:04:31.375436 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.375412    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"]
Jul 16 17:04:31.387121 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.387096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:31.478441 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-istio-token\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478441 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-envoy\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478699 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64df03e-3313-42ee-ace8-73844abfa51e-istio-podinfo\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478699 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64df03e-3313-42ee-ace8-73844abfa51e-istiod-ca-cert\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478699 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hgsn\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-kube-api-access-5hgsn\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478699 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-socket\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478854 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-data\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478854 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-credential-socket\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.478854 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.478788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-certs\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.484322 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.484296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:31.579510 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-istio-token\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-envoy\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64df03e-3313-42ee-ace8-73844abfa51e-istio-podinfo\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64df03e-3313-42ee-ace8-73844abfa51e-istiod-ca-cert\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hgsn\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-kube-api-access-5hgsn\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-socket\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-data\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-credential-socket\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.579897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.579882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-certs\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.580358 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.580127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-socket\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.580358 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.580173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-certs\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.580358 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.580267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-credential-socket\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.580471 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.580449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64df03e-3313-42ee-ace8-73844abfa51e-istiod-ca-cert\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.580581 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.580425    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-data\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.581947 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.581927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-envoy\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.582185 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.582162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64df03e-3313-42ee-ace8-73844abfa51e-istio-podinfo\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.587343 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.587314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-istio-token\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.587471 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.587405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hgsn\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-kube-api-access-5hgsn\") pod \"e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") " pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.675512 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.675446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:31.817109 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.817057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"]
Jul 16 17:04:31.819523 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:04:31.819494    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64df03e_3313_42ee_ace8_73844abfa51e.slice/crio-1d8fd7437fd542a840fe537a64e5b767efcaca741a4e219fbfcd75839e8c7bc8 WatchSource:0}: Error finding container 1d8fd7437fd542a840fe537a64e5b767efcaca741a4e219fbfcd75839e8c7bc8: Status 404 returned error can't find the container with id 1d8fd7437fd542a840fe537a64e5b767efcaca741a4e219fbfcd75839e8c7bc8
Jul 16 17:04:31.821772 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.821730    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:04:31.821876 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.821824    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:04:31.821876 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:31.821856    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:04:32.269970 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:32.269932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" event={"ID":"a64df03e-3313-42ee-ace8-73844abfa51e","Type":"ContainerStarted","Data":"63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"}
Jul 16 17:04:32.270213 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:32.269981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" event={"ID":"a64df03e-3313-42ee-ace8-73844abfa51e","Type":"ContainerStarted","Data":"1d8fd7437fd542a840fe537a64e5b767efcaca741a4e219fbfcd75839e8c7bc8"}
Jul 16 17:04:32.291423 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:32.291372    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" podStartSLOduration=1.2913557039999999 podStartE2EDuration="1.291355704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:04:32.289655672 +0000 UTC m=+2347.949895075" watchObservedRunningTime="2026-07-16 17:04:32.291355704 +0000 UTC m=+2347.951595107"
Jul 16 17:04:32.676322 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:32.676279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:32.681211 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:32.681187    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:33.274661 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:33.274632    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:33.275929 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:33.275909    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:34.279595 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:34.279554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:34.648801 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:34.648770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:34.751724 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:34.751693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:34.961813 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:34.961715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:35.060706 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:35.060674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:38.824934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:38.824895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:46.338844 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.338807    2564 generic.go:356] "Generic (PLEG): container finished" podID="a64df03e-3313-42ee-ace8-73844abfa51e" containerID="63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba" exitCode=0
Jul 16 17:04:46.339276 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.338882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" event={"ID":"a64df03e-3313-42ee-ace8-73844abfa51e","Type":"ContainerDied","Data":"63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"}
Jul 16 17:04:46.339346 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.339329    2564 scope.go:117] "RemoveContainer" containerID="63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"
Jul 16 17:04:46.340391 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.340359    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:04:46.340512 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.340445    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:04:46.340586 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.340513    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 16 17:04:46.696706 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:46.696641    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:04:47.345837 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:47.345801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" event={"ID":"a64df03e-3313-42ee-ace8-73844abfa51e","Type":"ContainerStarted","Data":"ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2"}
Jul 16 17:04:47.676135 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:47.676036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:47.677878 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:47.677536    2564 patch_prober.go:28] interesting pod/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 17:04:47.677878 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:47.677597    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 17:04:47.818782 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:47.818738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:47.938515 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:47.938379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:48.274971 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:48.274865    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:48.676307 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:48.676267    2564 patch_prober.go:28] interesting pod/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 17:04:48.676966 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:48.676927    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 17:04:49.676854 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:49.676789    2564 patch_prober.go:28] interesting pod/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 17:04:49.677452 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:49.677418    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 17:04:50.676693 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:50.676628    2564 patch_prober.go:28] interesting pod/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 17:04:50.677063 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:50.677030    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 17:04:51.680320 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:51.680289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:51.681385 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:51.681365    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:04:55.799137 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:55.799098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:58.622712 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:58.622676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:04:58.723160 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:04:58.723122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:02.000941 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:02.000905    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:05:02.538541 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:02.538479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:08.292274 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:08.292232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:08.757066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:08.757014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:12.934088 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:12.934042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:13.537527 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:13.537469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:13.883260 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:13.883228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:13.985764 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:13.985724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:23.850178 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:23.850139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:26.696714 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:26.696669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:05:27.612032 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:27.611999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:28.436005 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:28.435970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:34.418423 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:34.418383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:34.522868 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:34.522835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:39.204782 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:39.204730    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"]
Jul 16 17:05:39.205266 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:39.205074    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy" containerID="cri-o://ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2" gracePeriod=30
Jul 16 17:05:39.213348 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:39.213316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:39.432066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:39.432032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:39.790436 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:39.790398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:40.138762 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:40.138726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:40.355541 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:40.355504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:43.356439 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:43.356385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:43.457422 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:43.457360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:43.554859 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:43.554823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:43.655102 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:43.655070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:44.053585 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.053472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:44.153584 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.153551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:44.460652 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.460631    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:05:44.554575 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554540    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-data\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.554575 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-istio-token\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.554798 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-certs\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.554798 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-socket\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.554798 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-envoy\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.554798 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-credential-socket\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.555009 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64df03e-3313-42ee-ace8-73844abfa51e-istio-podinfo\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.555009 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554834    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hgsn\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-kube-api-access-5hgsn\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.555009 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64df03e-3313-42ee-ace8-73844abfa51e-istiod-ca-cert\") pod \"a64df03e-3313-42ee-ace8-73844abfa51e\" (UID: \"a64df03e-3313-42ee-ace8-73844abfa51e\") "
Jul 16 17:05:44.555009 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.554961    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:05:44.555212 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.555099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:05:44.555282 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.555257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64df03e-3313-42ee-ace8-73844abfa51e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:05:44.555333 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.555259    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.555333 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.555303    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-credential-socket\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.555423 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.555358    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:05:44.555864 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.555842    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:05:44.556999 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.556974    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:05:44.557186 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.557166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-kube-api-access-5hgsn" (OuterVolumeSpecName: "kube-api-access-5hgsn") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "kube-api-access-5hgsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:05:44.557413 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.557388    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:05:44.557413 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.557391    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a64df03e-3313-42ee-ace8-73844abfa51e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a64df03e-3313-42ee-ace8-73844abfa51e" (UID: "a64df03e-3313-42ee-ace8-73844abfa51e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 17:05:44.612183 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.612110    2564 generic.go:356] "Generic (PLEG): container finished" podID="a64df03e-3313-42ee-ace8-73844abfa51e" containerID="ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2" exitCode=0
Jul 16 17:05:44.612183 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.612171    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"
Jul 16 17:05:44.612183 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.612180    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" event={"ID":"a64df03e-3313-42ee-ace8-73844abfa51e","Type":"ContainerDied","Data":"ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2"}
Jul 16 17:05:44.612388 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.612222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp" event={"ID":"a64df03e-3313-42ee-ace8-73844abfa51e","Type":"ContainerDied","Data":"1d8fd7437fd542a840fe537a64e5b767efcaca741a4e219fbfcd75839e8c7bc8"}
Jul 16 17:05:44.612388 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.612244    2564 scope.go:117] "RemoveContainer" containerID="ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2"
Jul 16 17:05:44.621265 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.621245    2564 scope.go:117] "RemoveContainer" containerID="63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"
Jul 16 17:05:44.628864 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.628847    2564 scope.go:117] "RemoveContainer" containerID="ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2"
Jul 16 17:05:44.629114 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:05:44.629096    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2\": container with ID starting with ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2 not found: ID does not exist" containerID="ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2"
Jul 16 17:05:44.629159 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.629123    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2"} err="failed to get container status \"ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2\": rpc error: code = NotFound desc = could not find container \"ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2\": container with ID starting with ee793c2ab12bba8f45c118216d533b85851f397e1d9b275c188467943a61b7d2 not found: ID does not exist"
Jul 16 17:05:44.629159 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.629139    2564 scope.go:117] "RemoveContainer" containerID="63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"
Jul 16 17:05:44.629373 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:05:44.629356    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba\": container with ID starting with 63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba not found: ID does not exist" containerID="63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"
Jul 16 17:05:44.629417 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.629379    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba"} err="failed to get container status \"63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba\": rpc error: code = NotFound desc = could not find container \"63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba\": container with ID starting with 63e165aaa2d047bd5c513458d031f2a57b082d5f549819c8fc47d38a1cb467ba not found: ID does not exist"
Jul 16 17:05:44.637047 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.637026    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"]
Jul 16 17:05:44.642116 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.642096    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6da193-openshift-default-6d4f95cc8f-vf9qp"]
Jul 16 17:05:44.655866 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655848    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-envoy\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.655934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655871    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64df03e-3313-42ee-ace8-73844abfa51e-istio-podinfo\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.655934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655881    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hgsn\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-kube-api-access-5hgsn\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.655934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655891    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64df03e-3313-42ee-ace8-73844abfa51e-istiod-ca-cert\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.655934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655900    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-istio-data\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.655934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655907    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64df03e-3313-42ee-ace8-73844abfa51e-istio-token\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.655934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.655914    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64df03e-3313-42ee-ace8-73844abfa51e-workload-socket\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:05:44.876456 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:44.876423    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" path="/var/lib/kubelet/pods/a64df03e-3313-42ee-ace8-73844abfa51e/volumes"
Jul 16 17:05:47.877548 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:47.877439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:48.264550 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:48.264406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:48.590823 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:48.590731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:48.772881 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:48.772848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:51.916720 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:51.916675    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:05:51.998827 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:51.998795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:52.097098 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:52.097060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:52.200795 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:52.200698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:52.948691 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:52.948656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:53.044928 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:53.044899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:05:55.940951 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:05:55.940917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:04.941720 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:04.941682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:05.040389 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:05.040358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:06.804002 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:06.803969    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:06:09.742310 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.742276    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"]
Jul 16 17:06:09.742732 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.742614    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy"
Jul 16 17:06:09.742732 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.742625    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy"
Jul 16 17:06:09.742732 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.742639    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy"
Jul 16 17:06:09.742732 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.742645    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy"
Jul 16 17:06:09.742732 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.742703    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy"
Jul 16 17:06:09.745697 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.745680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.749865 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.749833    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0cb2ac\"/\"kube-root-ca.crt\""
Jul 16 17:06:09.749865 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.749842    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0cb2ac\"/\"auth-test-model-0cb2ac-kserve-self-signed-certs\""
Jul 16 17:06:09.750076 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.749897    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0cb2ac\"/\"openshift-service-ca.crt\""
Jul 16 17:06:09.750076 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.749979    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0cb2ac\"/\"default-dockercfg-qhng6\""
Jul 16 17:06:09.764866 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.764839    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"]
Jul 16 17:06:09.779541 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.779520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-model-cache\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.779654 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.779549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-dshm\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.779654 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.779566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-tmp-dir\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.779654 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.779593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/308fdc8c-35bd-4016-b2d2-4664cb99357a-tls-certs\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.779793 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.779655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-home\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.779793 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.779692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w26fb\" (UniqueName: \"kubernetes.io/projected/308fdc8c-35bd-4016-b2d2-4664cb99357a-kube-api-access-w26fb\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880391 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w26fb\" (UniqueName: \"kubernetes.io/projected/308fdc8c-35bd-4016-b2d2-4664cb99357a-kube-api-access-w26fb\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880391 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-model-cache\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880666 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-dshm\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880666 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-tmp-dir\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880666 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/308fdc8c-35bd-4016-b2d2-4664cb99357a-tls-certs\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880666 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-home\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880857 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-model-cache\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880926 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-tmp-dir\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.880980 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.880954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-home\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.882996 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.882971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-dshm\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.883200 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.883183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/308fdc8c-35bd-4016-b2d2-4664cb99357a-tls-certs\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:09.888813 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:09.888791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w26fb\" (UniqueName: \"kubernetes.io/projected/308fdc8c-35bd-4016-b2d2-4664cb99357a-kube-api-access-w26fb\") pod \"auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") " pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:10.054709 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:10.054626    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:10.193980 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:10.193955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"]
Jul 16 17:06:10.196384 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:06:10.196359    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod308fdc8c_35bd_4016_b2d2_4664cb99357a.slice/crio-b418d33d4d4ecb87c563eb81a1aada3fe9c3601bbf19e066417d959d1a1d78ed WatchSource:0}: Error finding container b418d33d4d4ecb87c563eb81a1aada3fe9c3601bbf19e066417d959d1a1d78ed: Status 404 returned error can't find the container with id b418d33d4d4ecb87c563eb81a1aada3fe9c3601bbf19e066417d959d1a1d78ed
Jul 16 17:06:10.216774 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:10.216748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:10.738452 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:10.738407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m" event={"ID":"308fdc8c-35bd-4016-b2d2-4664cb99357a","Type":"ContainerStarted","Data":"412bffd9830a245527ecd656d07917c239eedba9ff6e7348bbcaf4378abc04cf"}
Jul 16 17:06:10.738452 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:10.738456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m" event={"ID":"308fdc8c-35bd-4016-b2d2-4664cb99357a","Type":"ContainerStarted","Data":"b418d33d4d4ecb87c563eb81a1aada3fe9c3601bbf19e066417d959d1a1d78ed"}
Jul 16 17:06:10.758110 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:10.758061    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m" podStartSLOduration=1.758045082 podStartE2EDuration="1.758045082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:06:10.756469536 +0000 UTC m=+2446.416708940" watchObservedRunningTime="2026-07-16 17:06:10.758045082 +0000 UTC m=+2446.418284486"
Jul 16 17:06:13.024469 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:13.024423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:13.129000 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:13.128961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:15.761092 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:15.761057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:16.795631 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:16.795591    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:06:20.055047 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:20.055010    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:20.055467 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:20.055293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:20.067851 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:20.067830    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:20.793936 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:20.793904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:06:24.650774 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:24.650745    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:24.752028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:24.751998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:33.833109 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.833077    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"]
Jul 16 17:06:33.833510 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.833465    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64df03e-3313-42ee-ace8-73844abfa51e" containerName="istio-proxy"
Jul 16 17:06:33.836221 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.836201    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:33.839778 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.839759    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"kube-root-ca.crt\""
Jul 16 17:06:33.839949 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.839928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"default-dockercfg-dwg8q\""
Jul 16 17:06:33.840039 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.839947    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"openshift-service-ca.crt\""
Jul 16 17:06:33.840039 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.839927    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"auth-test-model-734b32-kserve-self-signed-certs\""
Jul 16 17:06:33.847364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.847343    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"]
Jul 16 17:06:33.865046 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.865022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:06:33.982841 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.982807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-dshm\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:33.983028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.982848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-home\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:33.983028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.982873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/210c246c-4727-488f-838c-ed5e560318c5-tls-certs\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:33.983028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.982892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-model-cache\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:33.983028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.982940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgmdh\" (UniqueName: \"kubernetes.io/projected/210c246c-4727-488f-838c-ed5e560318c5-kube-api-access-zgmdh\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:33.983225 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:33.983031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-tmp-dir\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.083670 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.083577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-dshm\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.083670 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.083630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-home\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.083670 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.083659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/210c246c-4727-488f-838c-ed5e560318c5-tls-certs\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.083940 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.083685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-model-cache\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.083940 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.083717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgmdh\" (UniqueName: \"kubernetes.io/projected/210c246c-4727-488f-838c-ed5e560318c5-kube-api-access-zgmdh\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.083940 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.083793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-tmp-dir\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.084104 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.084084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-home\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.084169 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.084108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-model-cache\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.084226 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.084182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-tmp-dir\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.085951 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.085924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-dshm\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.086210 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.086193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/210c246c-4727-488f-838c-ed5e560318c5-tls-certs\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.092735 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.092716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgmdh\" (UniqueName: \"kubernetes.io/projected/210c246c-4727-488f-838c-ed5e560318c5-kube-api-access-zgmdh\") pod \"auth-test-model-734b32-kserve-64676c46dc-rb4pj\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") " pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.145428 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.145396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:34.295365 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.295341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"]
Jul 16 17:06:34.296882 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:06:34.296855    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod210c246c_4727_488f_838c_ed5e560318c5.slice/crio-014c6178adee515ca3a1e738c95766d1f18ed1be21ce182b1e1dbcae4f0b0fe6 WatchSource:0}: Error finding container 014c6178adee515ca3a1e738c95766d1f18ed1be21ce182b1e1dbcae4f0b0fe6: Status 404 returned error can't find the container with id 014c6178adee515ca3a1e738c95766d1f18ed1be21ce182b1e1dbcae4f0b0fe6
Jul 16 17:06:34.847128 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.847086    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj" event={"ID":"210c246c-4727-488f-838c-ed5e560318c5","Type":"ContainerStarted","Data":"3163fa06601856f30a6e5bea05fd5fe59ff239c8cd0353300ad12033ab29523c"}
Jul 16 17:06:34.847591 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.847140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj" event={"ID":"210c246c-4727-488f-838c-ed5e560318c5","Type":"ContainerStarted","Data":"014c6178adee515ca3a1e738c95766d1f18ed1be21ce182b1e1dbcae4f0b0fe6"}
Jul 16 17:06:34.866851 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:34.866805    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj" podStartSLOduration=1.866788327 podStartE2EDuration="1.866788327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:06:34.866165949 +0000 UTC m=+2470.526405353" watchObservedRunningTime="2026-07-16 17:06:34.866788327 +0000 UTC m=+2470.527027709"
Jul 16 17:06:37.693832 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:37.693792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:06:44.145646 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:44.145610    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:44.146226 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:44.145663    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:44.158043 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:44.158010    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:44.902641 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:44.902615    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:06:55.809347 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:06:55.809308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:07:08.776255 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:07:08.776218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:07:14.445191 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:07:14.445153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:07:14.508353 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:07:14.508322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:07:14.992368 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:07:14.992331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:07:32.608371 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:07:32.608294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:07:49.899830 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:07:49.899794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:08:06.302999 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:06.302967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:08:18.952294 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:18.952261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:08:19.060809 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:19.060773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:08:22.808979 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:22.808940    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:08:41.740505 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:41.740460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:08:47.378249 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:47.378166    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"]
Jul 16 17:08:47.438328 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:47.438297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:08:48.373046 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:48.373008    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"]
Jul 16 17:08:48.434729 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:48.434698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:08:55.276597 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.276568    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"]
Jul 16 17:08:55.279832 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.279816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.283852 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.283831    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0cb2ac\"/\"sub-test-model-0cb2ac-kserve-self-signed-certs\""
Jul 16 17:08:55.306385 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.306360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"]
Jul 16 17:08:55.336089 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.336052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:08:55.374571 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.374544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce11666d-1507-45da-98eb-b4d5a8595fb9-tls-certs\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.374571 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.374574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqglt\" (UniqueName: \"kubernetes.io/projected/ce11666d-1507-45da-98eb-b4d5a8595fb9-kube-api-access-zqglt\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.374755 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.374640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-model-cache\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.374755 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.374659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-tmp-dir\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.374821 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.374768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-home\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.374821 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.374796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-dshm\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.475772 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.475739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-model-cache\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.475965 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.475781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-tmp-dir\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.475965 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.475916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-home\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.475965 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.475957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-dshm\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.476132 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.476015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce11666d-1507-45da-98eb-b4d5a8595fb9-tls-certs\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.476132 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.476039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqglt\" (UniqueName: \"kubernetes.io/projected/ce11666d-1507-45da-98eb-b4d5a8595fb9-kube-api-access-zqglt\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.476232 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.476132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-tmp-dir\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.476232 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.476192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-model-cache\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.476328 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.476250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-home\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.478282 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.478259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-dshm\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.478589 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.478571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce11666d-1507-45da-98eb-b4d5a8595fb9-tls-certs\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.485614 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.485591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqglt\" (UniqueName: \"kubernetes.io/projected/ce11666d-1507-45da-98eb-b4d5a8595fb9-kube-api-access-zqglt\") pod \"sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") " pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.589011 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.588920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:08:55.723663 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:55.723637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"]
Jul 16 17:08:55.725462 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:08:55.725435    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce11666d_1507_45da_98eb_b4d5a8595fb9.slice/crio-bfd6eecf1b285ce42839aebae5627511aa65bb21f907490562d735a11347d28a WatchSource:0}: Error finding container bfd6eecf1b285ce42839aebae5627511aa65bb21f907490562d735a11347d28a: Status 404 returned error can't find the container with id bfd6eecf1b285ce42839aebae5627511aa65bb21f907490562d735a11347d28a
Jul 16 17:08:56.489135 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:56.489108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj" event={"ID":"ce11666d-1507-45da-98eb-b4d5a8595fb9","Type":"ContainerStarted","Data":"4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00"}
Jul 16 17:08:56.489562 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:56.489145    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj" event={"ID":"ce11666d-1507-45da-98eb-b4d5a8595fb9","Type":"ContainerStarted","Data":"bfd6eecf1b285ce42839aebae5627511aa65bb21f907490562d735a11347d28a"}
Jul 16 17:08:56.514448 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:08:56.514402    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj" podStartSLOduration=1.514386295 podStartE2EDuration="1.514386295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:08:56.513122772 +0000 UTC m=+2612.173362187" watchObservedRunningTime="2026-07-16 17:08:56.514386295 +0000 UTC m=+2612.174625698"
Jul 16 17:09:02.397949 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.397901    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m" podUID="308fdc8c-35bd-4016-b2d2-4664cb99357a" containerName="main" containerID="cri-o://412bffd9830a245527ecd656d07917c239eedba9ff6e7348bbcaf4378abc04cf" gracePeriod=45
Jul 16 17:09:02.419270 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.419245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:09:02.519411 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.519382    2564 generic.go:356] "Generic (PLEG): container finished" podID="308fdc8c-35bd-4016-b2d2-4664cb99357a" containerID="412bffd9830a245527ecd656d07917c239eedba9ff6e7348bbcaf4378abc04cf" exitCode=0
Jul 16 17:09:02.519573 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.519449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m" event={"ID":"308fdc8c-35bd-4016-b2d2-4664cb99357a","Type":"ContainerDied","Data":"412bffd9830a245527ecd656d07917c239eedba9ff6e7348bbcaf4378abc04cf"}
Jul 16 17:09:02.653099 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.653037    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:09:02.739883 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.739857    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-model-cache\") pod \"308fdc8c-35bd-4016-b2d2-4664cb99357a\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") "
Jul 16 17:09:02.740066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.739911    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/308fdc8c-35bd-4016-b2d2-4664cb99357a-tls-certs\") pod \"308fdc8c-35bd-4016-b2d2-4664cb99357a\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") "
Jul 16 17:09:02.740066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.739933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w26fb\" (UniqueName: \"kubernetes.io/projected/308fdc8c-35bd-4016-b2d2-4664cb99357a-kube-api-access-w26fb\") pod \"308fdc8c-35bd-4016-b2d2-4664cb99357a\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") "
Jul 16 17:09:02.740066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.739958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-home\") pod \"308fdc8c-35bd-4016-b2d2-4664cb99357a\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") "
Jul 16 17:09:02.740066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.739974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-dshm\") pod \"308fdc8c-35bd-4016-b2d2-4664cb99357a\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") "
Jul 16 17:09:02.740066 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.740011    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-tmp-dir\") pod \"308fdc8c-35bd-4016-b2d2-4664cb99357a\" (UID: \"308fdc8c-35bd-4016-b2d2-4664cb99357a\") "
Jul 16 17:09:02.740334 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.740210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-model-cache" (OuterVolumeSpecName: "model-cache") pod "308fdc8c-35bd-4016-b2d2-4664cb99357a" (UID: "308fdc8c-35bd-4016-b2d2-4664cb99357a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:02.740334 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.740221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-home" (OuterVolumeSpecName: "home") pod "308fdc8c-35bd-4016-b2d2-4664cb99357a" (UID: "308fdc8c-35bd-4016-b2d2-4664cb99357a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:02.740450 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.740336    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "308fdc8c-35bd-4016-b2d2-4664cb99357a" (UID: "308fdc8c-35bd-4016-b2d2-4664cb99357a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:02.742199 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.742170    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308fdc8c-35bd-4016-b2d2-4664cb99357a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "308fdc8c-35bd-4016-b2d2-4664cb99357a" (UID: "308fdc8c-35bd-4016-b2d2-4664cb99357a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:09:02.742714 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.742692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-dshm" (OuterVolumeSpecName: "dshm") pod "308fdc8c-35bd-4016-b2d2-4664cb99357a" (UID: "308fdc8c-35bd-4016-b2d2-4664cb99357a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:02.742793 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.742730    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308fdc8c-35bd-4016-b2d2-4664cb99357a-kube-api-access-w26fb" (OuterVolumeSpecName: "kube-api-access-w26fb") pod "308fdc8c-35bd-4016-b2d2-4664cb99357a" (UID: "308fdc8c-35bd-4016-b2d2-4664cb99357a"). InnerVolumeSpecName "kube-api-access-w26fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:09:02.840797 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.840761    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:02.840797 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.840791    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/308fdc8c-35bd-4016-b2d2-4664cb99357a-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:02.840797 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.840799    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w26fb\" (UniqueName: \"kubernetes.io/projected/308fdc8c-35bd-4016-b2d2-4664cb99357a-kube-api-access-w26fb\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:02.841036 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.840810    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:02.841036 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.840818    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:02.841036 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:02.840825    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308fdc8c-35bd-4016-b2d2-4664cb99357a-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:03.392679 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.392631    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj" podUID="210c246c-4727-488f-838c-ed5e560318c5" containerName="main" containerID="cri-o://3163fa06601856f30a6e5bea05fd5fe59ff239c8cd0353300ad12033ab29523c" gracePeriod=45
Jul 16 17:09:03.527138 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.527106    2564 generic.go:356] "Generic (PLEG): container finished" podID="210c246c-4727-488f-838c-ed5e560318c5" containerID="3163fa06601856f30a6e5bea05fd5fe59ff239c8cd0353300ad12033ab29523c" exitCode=0
Jul 16 17:09:03.527646 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.527187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj" event={"ID":"210c246c-4727-488f-838c-ed5e560318c5","Type":"ContainerDied","Data":"3163fa06601856f30a6e5bea05fd5fe59ff239c8cd0353300ad12033ab29523c"}
Jul 16 17:09:03.528569 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.528550    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"
Jul 16 17:09:03.528670 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.528577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m" event={"ID":"308fdc8c-35bd-4016-b2d2-4664cb99357a","Type":"ContainerDied","Data":"b418d33d4d4ecb87c563eb81a1aada3fe9c3601bbf19e066417d959d1a1d78ed"}
Jul 16 17:09:03.528670 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.528634    2564 scope.go:117] "RemoveContainer" containerID="412bffd9830a245527ecd656d07917c239eedba9ff6e7348bbcaf4378abc04cf"
Jul 16 17:09:03.568970 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.568940    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"]
Jul 16 17:09:03.572585 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.572557    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/auth-test-model-0cb2ac-kserve-56fc8c5d99-kjw2m"]
Jul 16 17:09:03.636743 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.636719    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:09:03.748769 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/210c246c-4727-488f-838c-ed5e560318c5-tls-certs\") pod \"210c246c-4727-488f-838c-ed5e560318c5\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") "
Jul 16 17:09:03.748769 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748718    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-tmp-dir\") pod \"210c246c-4727-488f-838c-ed5e560318c5\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") "
Jul 16 17:09:03.748769 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748755    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgmdh\" (UniqueName: \"kubernetes.io/projected/210c246c-4727-488f-838c-ed5e560318c5-kube-api-access-zgmdh\") pod \"210c246c-4727-488f-838c-ed5e560318c5\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") "
Jul 16 17:09:03.749041 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748777    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-dshm\") pod \"210c246c-4727-488f-838c-ed5e560318c5\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") "
Jul 16 17:09:03.749041 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-model-cache\") pod \"210c246c-4727-488f-838c-ed5e560318c5\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") "
Jul 16 17:09:03.749041 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748879    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-home\") pod \"210c246c-4727-488f-838c-ed5e560318c5\" (UID: \"210c246c-4727-488f-838c-ed5e560318c5\") "
Jul 16 17:09:03.749041 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.748976    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "210c246c-4727-488f-838c-ed5e560318c5" (UID: "210c246c-4727-488f-838c-ed5e560318c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:03.749217 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.749110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "210c246c-4727-488f-838c-ed5e560318c5" (UID: "210c246c-4727-488f-838c-ed5e560318c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:03.749217 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.749186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-home" (OuterVolumeSpecName: "home") pod "210c246c-4727-488f-838c-ed5e560318c5" (UID: "210c246c-4727-488f-838c-ed5e560318c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:03.749217 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.749204    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:03.751115 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.751086    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210c246c-4727-488f-838c-ed5e560318c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "210c246c-4727-488f-838c-ed5e560318c5" (UID: "210c246c-4727-488f-838c-ed5e560318c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:09:03.751247 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.751126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210c246c-4727-488f-838c-ed5e560318c5-kube-api-access-zgmdh" (OuterVolumeSpecName: "kube-api-access-zgmdh") pod "210c246c-4727-488f-838c-ed5e560318c5" (UID: "210c246c-4727-488f-838c-ed5e560318c5"). InnerVolumeSpecName "kube-api-access-zgmdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:09:03.751247 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.751141    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-dshm" (OuterVolumeSpecName: "dshm") pod "210c246c-4727-488f-838c-ed5e560318c5" (UID: "210c246c-4727-488f-838c-ed5e560318c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:09:03.850013 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.849977    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:03.850013 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.850004    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/210c246c-4727-488f-838c-ed5e560318c5-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:03.850013 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.850016    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgmdh\" (UniqueName: \"kubernetes.io/projected/210c246c-4727-488f-838c-ed5e560318c5-kube-api-access-zgmdh\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:03.850013 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.850025    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:03.850291 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:03.850032    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/210c246c-4727-488f-838c-ed5e560318c5-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:09:04.540471 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.540438    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"
Jul 16 17:09:04.540920 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.540437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj" event={"ID":"210c246c-4727-488f-838c-ed5e560318c5","Type":"ContainerDied","Data":"014c6178adee515ca3a1e738c95766d1f18ed1be21ce182b1e1dbcae4f0b0fe6"}
Jul 16 17:09:04.540920 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.540544    2564 scope.go:117] "RemoveContainer" containerID="3163fa06601856f30a6e5bea05fd5fe59ff239c8cd0353300ad12033ab29523c"
Jul 16 17:09:04.566710 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.566683    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"]
Jul 16 17:09:04.568611 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.568593    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/auth-test-model-734b32-kserve-64676c46dc-rb4pj"]
Jul 16 17:09:04.875679 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.875645    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210c246c-4727-488f-838c-ed5e560318c5" path="/var/lib/kubelet/pods/210c246c-4727-488f-838c-ed5e560318c5/volumes"
Jul 16 17:09:04.876067 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:04.876054    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308fdc8c-35bd-4016-b2d2-4664cb99357a" path="/var/lib/kubelet/pods/308fdc8c-35bd-4016-b2d2-4664cb99357a/volumes"
Jul 16 17:09:05.589671 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:05.589639    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:09:05.590074 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:05.589706    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:09:05.601867 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:05.601839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:09:06.561541 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:06.561515    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:09:13.589719 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.589682    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"]
Jul 16 17:09:13.590117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.590024    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308fdc8c-35bd-4016-b2d2-4664cb99357a" containerName="main"
Jul 16 17:09:13.590117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.590034    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="308fdc8c-35bd-4016-b2d2-4664cb99357a" containerName="main"
Jul 16 17:09:13.590117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.590042    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210c246c-4727-488f-838c-ed5e560318c5" containerName="main"
Jul 16 17:09:13.590117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.590047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="210c246c-4727-488f-838c-ed5e560318c5" containerName="main"
Jul 16 17:09:13.590117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.590100    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="210c246c-4727-488f-838c-ed5e560318c5" containerName="main"
Jul 16 17:09:13.590117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.590108    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="308fdc8c-35bd-4016-b2d2-4664cb99357a" containerName="main"
Jul 16 17:09:13.594260 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.594241    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.600266 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:09:13.600141    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-734b32\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 16 17:09:13.600266 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:09:13.600193    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"sub-test-model-734b32-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-734b32\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"sub-test-model-734b32-kserve-self-signed-certs\"" type="*v1.Secret"
Jul 16 17:09:13.600266 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:09:13.600204    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-734b32\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 16 17:09:13.600266 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:09:13.600208    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-734b32\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="b933c85f-d190-402f-95ed-85c7cc8a646c" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.600266 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:09:13.600227    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-dwg8q\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-734b32\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"default-dockercfg-dwg8q\"" type="*v1.Secret"
Jul 16 17:09:13.616631 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.616606    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"]
Jul 16 17:09:13.639673 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.639645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-dshm\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.639803 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.639685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b933c85f-d190-402f-95ed-85c7cc8a646c-tls-certs\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.639803 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.639748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sphbz\" (UniqueName: \"kubernetes.io/projected/b933c85f-d190-402f-95ed-85c7cc8a646c-kube-api-access-sphbz\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.639803 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.639780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-model-cache\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.639803 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.639800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-home\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.639989 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.639891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-tmp-dir\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.656660 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.656629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:09:13.741155 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-tmp-dir\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741299 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-dshm\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741299 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b933c85f-d190-402f-95ed-85c7cc8a646c-tls-certs\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741299 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sphbz\" (UniqueName: \"kubernetes.io/projected/b933c85f-d190-402f-95ed-85c7cc8a646c-kube-api-access-sphbz\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741299 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-model-cache\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741537 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-home\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741601 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-tmp-dir\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741668 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-model-cache\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.741710 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.741693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-home\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:13.743549 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:13.743533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-dshm\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:14.525856 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:14.525823    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"kube-root-ca.crt\""
Jul 16 17:09:14.537135 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:14.537115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"sub-test-model-734b32-kserve-self-signed-certs\""
Jul 16 17:09:14.544414 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:14.544397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b933c85f-d190-402f-95ed-85c7cc8a646c-tls-certs\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:14.568465 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:14.568430    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"default-dockercfg-dwg8q\""
Jul 16 17:09:14.848992 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:14.848904    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"openshift-service-ca.crt\""
Jul 16 17:09:14.852253 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:14.852228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sphbz\" (UniqueName: \"kubernetes.io/projected/b933c85f-d190-402f-95ed-85c7cc8a646c-kube-api-access-sphbz\") pod \"sub-test-model-734b32-kserve-76c497f57c-qmq4z\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") " pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:15.104539 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:15.104446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:15.258139 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:15.258116    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"]
Jul 16 17:09:15.260108 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:09:15.260081    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb933c85f_d190_402f_95ed_85c7cc8a646c.slice/crio-484eb0c7574eb2dda2cfcdecfdffd23361fe773120dba7628b5f6fa0a14652b0 WatchSource:0}: Error finding container 484eb0c7574eb2dda2cfcdecfdffd23361fe773120dba7628b5f6fa0a14652b0: Status 404 returned error can't find the container with id 484eb0c7574eb2dda2cfcdecfdffd23361fe773120dba7628b5f6fa0a14652b0
Jul 16 17:09:15.592104 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:15.592065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z" event={"ID":"b933c85f-d190-402f-95ed-85c7cc8a646c","Type":"ContainerStarted","Data":"8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe"}
Jul 16 17:09:15.592104 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:15.592112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z" event={"ID":"b933c85f-d190-402f-95ed-85c7cc8a646c","Type":"ContainerStarted","Data":"484eb0c7574eb2dda2cfcdecfdffd23361fe773120dba7628b5f6fa0a14652b0"}
Jul 16 17:09:15.623331 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:15.623286    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z" podStartSLOduration=2.623273466 podStartE2EDuration="2.623273466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:09:15.623198555 +0000 UTC m=+2631.283437958" watchObservedRunningTime="2026-07-16 17:09:15.623273466 +0000 UTC m=+2631.283512866"
Jul 16 17:09:21.522420 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:21.522384    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:09:25.105325 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:25.105291    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:25.105684 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:25.105339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:25.117296 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:25.117275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:25.646561 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:25.646533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:09:50.006431 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:09:50.006395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:10:04.521409 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:04.521377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:10:11.026937 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:11.026908    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"]
Jul 16 17:10:11.062405 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:11.062377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:10:11.787173 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:11.787145    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"]
Jul 16 17:10:13.278168 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:13.278135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:10:19.445038 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.444961    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"]
Jul 16 17:10:19.448470 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.448434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.451474 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.451454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0cb2ac\"/\"rate-test-model-0cb2ac-kserve-self-signed-certs\""
Jul 16 17:10:19.461136 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.461111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"]
Jul 16 17:10:19.485741 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.485710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:10:19.526275 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.526239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt7ts\" (UniqueName: \"kubernetes.io/projected/8f3766dd-cd87-4081-812a-074772f330c1-kube-api-access-tt7ts\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.526275 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.526278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-home\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.526536 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.526299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-model-cache\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.526536 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.526379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-tmp-dir\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.526536 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.526408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3766dd-cd87-4081-812a-074772f330c1-tls-certs\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.526536 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.526437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-dshm\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627408 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-tmp-dir\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627631 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3766dd-cd87-4081-812a-074772f330c1-tls-certs\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627631 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-dshm\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627631 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt7ts\" (UniqueName: \"kubernetes.io/projected/8f3766dd-cd87-4081-812a-074772f330c1-kube-api-access-tt7ts\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627805 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-home\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627805 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-model-cache\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627904 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-tmp-dir\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.627995 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.627965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-home\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.628071 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.628011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-model-cache\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.629782 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.629759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-dshm\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.630026 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.630007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3766dd-cd87-4081-812a-074772f330c1-tls-certs\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.637113 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.637095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt7ts\" (UniqueName: \"kubernetes.io/projected/8f3766dd-cd87-4081-812a-074772f330c1-kube-api-access-tt7ts\") pod \"rate-test-model-0cb2ac-kserve-b95849cc9-fllqf\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") " pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.757448 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.757369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:19.895073 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:19.895053    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"]
Jul 16 17:10:19.896922 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:10:19.896896    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f3766dd_cd87_4081_812a_074772f330c1.slice/crio-3014cb8204bcdbd1dda493f48c59a88791d7b1785f248c626cdff852061068fc WatchSource:0}: Error finding container 3014cb8204bcdbd1dda493f48c59a88791d7b1785f248c626cdff852061068fc: Status 404 returned error can't find the container with id 3014cb8204bcdbd1dda493f48c59a88791d7b1785f248c626cdff852061068fc
Jul 16 17:10:20.879758 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:20.879726    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf" event={"ID":"8f3766dd-cd87-4081-812a-074772f330c1","Type":"ContainerStarted","Data":"df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777"}
Jul 16 17:10:20.880131 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:20.879765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf" event={"ID":"8f3766dd-cd87-4081-812a-074772f330c1","Type":"ContainerStarted","Data":"3014cb8204bcdbd1dda493f48c59a88791d7b1785f248c626cdff852061068fc"}
Jul 16 17:10:20.901788 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:20.901739    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf" podStartSLOduration=1.9017248 podStartE2EDuration="1.9017248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:10:20.900115546 +0000 UTC m=+2696.560354950" watchObservedRunningTime="2026-07-16 17:10:20.9017248 +0000 UTC m=+2696.561964203"
Jul 16 17:10:23.022559 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:23.022526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:10:26.806940 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:26.806878    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z" podUID="b933c85f-d190-402f-95ed-85c7cc8a646c" containerName="main" containerID="cri-o://8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe" gracePeriod=45
Jul 16 17:10:26.857003 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:26.856948    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj" podUID="ce11666d-1507-45da-98eb-b4d5a8595fb9" containerName="main" containerID="cri-o://4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00" gracePeriod=45
Jul 16 17:10:27.102351 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.102322    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:10:27.132055 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.132028    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:10:27.191120 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-model-cache\") pod \"b933c85f-d190-402f-95ed-85c7cc8a646c\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") "
Jul 16 17:10:27.191273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191129    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sphbz\" (UniqueName: \"kubernetes.io/projected/b933c85f-d190-402f-95ed-85c7cc8a646c-kube-api-access-sphbz\") pod \"b933c85f-d190-402f-95ed-85c7cc8a646c\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") "
Jul 16 17:10:27.191273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191193    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b933c85f-d190-402f-95ed-85c7cc8a646c-tls-certs\") pod \"b933c85f-d190-402f-95ed-85c7cc8a646c\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") "
Jul 16 17:10:27.191273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191208    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-tmp-dir\") pod \"b933c85f-d190-402f-95ed-85c7cc8a646c\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") "
Jul 16 17:10:27.191273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-dshm\") pod \"b933c85f-d190-402f-95ed-85c7cc8a646c\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") "
Jul 16 17:10:27.191474 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-home\") pod \"b933c85f-d190-402f-95ed-85c7cc8a646c\" (UID: \"b933c85f-d190-402f-95ed-85c7cc8a646c\") "
Jul 16 17:10:27.191474 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191394    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-model-cache" (OuterVolumeSpecName: "model-cache") pod "b933c85f-d190-402f-95ed-85c7cc8a646c" (UID: "b933c85f-d190-402f-95ed-85c7cc8a646c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.191614 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b933c85f-d190-402f-95ed-85c7cc8a646c" (UID: "b933c85f-d190-402f-95ed-85c7cc8a646c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.191614 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191568    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.191614 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191611    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.191982 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.191634    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-home" (OuterVolumeSpecName: "home") pod "b933c85f-d190-402f-95ed-85c7cc8a646c" (UID: "b933c85f-d190-402f-95ed-85c7cc8a646c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.193385 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.193356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-dshm" (OuterVolumeSpecName: "dshm") pod "b933c85f-d190-402f-95ed-85c7cc8a646c" (UID: "b933c85f-d190-402f-95ed-85c7cc8a646c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.193515 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.193403    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b933c85f-d190-402f-95ed-85c7cc8a646c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b933c85f-d190-402f-95ed-85c7cc8a646c" (UID: "b933c85f-d190-402f-95ed-85c7cc8a646c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:10:27.193515 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.193418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b933c85f-d190-402f-95ed-85c7cc8a646c-kube-api-access-sphbz" (OuterVolumeSpecName: "kube-api-access-sphbz") pod "b933c85f-d190-402f-95ed-85c7cc8a646c" (UID: "b933c85f-d190-402f-95ed-85c7cc8a646c"). InnerVolumeSpecName "kube-api-access-sphbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:10:27.292782 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.292750    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-tmp-dir\") pod \"ce11666d-1507-45da-98eb-b4d5a8595fb9\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") "
Jul 16 17:10:27.292782 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.292788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-home\") pod \"ce11666d-1507-45da-98eb-b4d5a8595fb9\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") "
Jul 16 17:10:27.293003 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.292827    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqglt\" (UniqueName: \"kubernetes.io/projected/ce11666d-1507-45da-98eb-b4d5a8595fb9-kube-api-access-zqglt\") pod \"ce11666d-1507-45da-98eb-b4d5a8595fb9\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") "
Jul 16 17:10:27.293003 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.292850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-model-cache\") pod \"ce11666d-1507-45da-98eb-b4d5a8595fb9\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") "
Jul 16 17:10:27.293003 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.292869    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-dshm\") pod \"ce11666d-1507-45da-98eb-b4d5a8595fb9\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") "
Jul 16 17:10:27.293003 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.292911    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce11666d-1507-45da-98eb-b4d5a8595fb9-tls-certs\") pod \"ce11666d-1507-45da-98eb-b4d5a8595fb9\" (UID: \"ce11666d-1507-45da-98eb-b4d5a8595fb9\") "
Jul 16 17:10:27.293214 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293028    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce11666d-1507-45da-98eb-b4d5a8595fb9" (UID: "ce11666d-1507-45da-98eb-b4d5a8595fb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.293214 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-home" (OuterVolumeSpecName: "home") pod "ce11666d-1507-45da-98eb-b4d5a8595fb9" (UID: "ce11666d-1507-45da-98eb-b4d5a8595fb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.293214 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293184    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce11666d-1507-45da-98eb-b4d5a8595fb9" (UID: "ce11666d-1507-45da-98eb-b4d5a8595fb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.293214 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293196    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.293214 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293212    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.293427 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293224    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b933c85f-d190-402f-95ed-85c7cc8a646c-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.293427 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293234    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.293427 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293245    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b933c85f-d190-402f-95ed-85c7cc8a646c-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.293427 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.293265    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sphbz\" (UniqueName: \"kubernetes.io/projected/b933c85f-d190-402f-95ed-85c7cc8a646c-kube-api-access-sphbz\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.295115 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.295097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-dshm" (OuterVolumeSpecName: "dshm") pod "ce11666d-1507-45da-98eb-b4d5a8595fb9" (UID: "ce11666d-1507-45da-98eb-b4d5a8595fb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:10:27.295179 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.295120    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce11666d-1507-45da-98eb-b4d5a8595fb9-kube-api-access-zqglt" (OuterVolumeSpecName: "kube-api-access-zqglt") pod "ce11666d-1507-45da-98eb-b4d5a8595fb9" (UID: "ce11666d-1507-45da-98eb-b4d5a8595fb9"). InnerVolumeSpecName "kube-api-access-zqglt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:10:27.295179 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.295138    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce11666d-1507-45da-98eb-b4d5a8595fb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce11666d-1507-45da-98eb-b4d5a8595fb9" (UID: "ce11666d-1507-45da-98eb-b4d5a8595fb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:10:27.393978 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.393952    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqglt\" (UniqueName: \"kubernetes.io/projected/ce11666d-1507-45da-98eb-b4d5a8595fb9-kube-api-access-zqglt\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.393978 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.393977    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.393978 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.393986    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce11666d-1507-45da-98eb-b4d5a8595fb9-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.394226 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.393995    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce11666d-1507-45da-98eb-b4d5a8595fb9-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:10:27.913135 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.913101    2564 generic.go:356] "Generic (PLEG): container finished" podID="ce11666d-1507-45da-98eb-b4d5a8595fb9" containerID="4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00" exitCode=0
Jul 16 17:10:27.913621 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.913151    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"
Jul 16 17:10:27.913621 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.913190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj" event={"ID":"ce11666d-1507-45da-98eb-b4d5a8595fb9","Type":"ContainerDied","Data":"4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00"}
Jul 16 17:10:27.913621 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.913233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj" event={"ID":"ce11666d-1507-45da-98eb-b4d5a8595fb9","Type":"ContainerDied","Data":"bfd6eecf1b285ce42839aebae5627511aa65bb21f907490562d735a11347d28a"}
Jul 16 17:10:27.913621 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.913259    2564 scope.go:117] "RemoveContainer" containerID="4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00"
Jul 16 17:10:27.914653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.914391    2564 generic.go:356] "Generic (PLEG): container finished" podID="b933c85f-d190-402f-95ed-85c7cc8a646c" containerID="8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe" exitCode=0
Jul 16 17:10:27.914653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.914438    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"
Jul 16 17:10:27.914653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.914448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z" event={"ID":"b933c85f-d190-402f-95ed-85c7cc8a646c","Type":"ContainerDied","Data":"8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe"}
Jul 16 17:10:27.914653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.914509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z" event={"ID":"b933c85f-d190-402f-95ed-85c7cc8a646c","Type":"ContainerDied","Data":"484eb0c7574eb2dda2cfcdecfdffd23361fe773120dba7628b5f6fa0a14652b0"}
Jul 16 17:10:27.922627 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.922611    2564 scope.go:117] "RemoveContainer" containerID="4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00"
Jul 16 17:10:27.922884 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:10:27.922865    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00\": container with ID starting with 4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00 not found: ID does not exist" containerID="4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00"
Jul 16 17:10:27.922956 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.922892    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00"} err="failed to get container status \"4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00\": rpc error: code = NotFound desc = could not find container \"4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00\": container with ID starting with 4882cd3e83dbcf8b47009ab7f9c7379ffbf006c9f9ea89933e6d38f36f165f00 not found: ID does not exist"
Jul 16 17:10:27.922956 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.922911    2564 scope.go:117] "RemoveContainer" containerID="8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe"
Jul 16 17:10:27.930366 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.930348    2564 scope.go:117] "RemoveContainer" containerID="8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe"
Jul 16 17:10:27.930635 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:10:27.930616    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe\": container with ID starting with 8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe not found: ID does not exist" containerID="8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe"
Jul 16 17:10:27.930687 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.930642    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe"} err="failed to get container status \"8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe\": rpc error: code = NotFound desc = could not find container \"8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe\": container with ID starting with 8caabdec1958c2b14fe487f8e69af92b6bf1c334d30e926ca8691bd9ec394efe not found: ID does not exist"
Jul 16 17:10:27.950058 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.950037    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"]
Jul 16 17:10:27.953072 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.953051    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/sub-test-model-734b32-kserve-76c497f57c-qmq4z"]
Jul 16 17:10:27.970942 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.970922    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"]
Jul 16 17:10:27.979510 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:27.979474    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/sub-test-model-0cb2ac-kserve-598cccc7df-hqwbj"]
Jul 16 17:10:28.875278 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:28.875245    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b933c85f-d190-402f-95ed-85c7cc8a646c" path="/var/lib/kubelet/pods/b933c85f-d190-402f-95ed-85c7cc8a646c/volumes"
Jul 16 17:10:28.875643 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:28.875629    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce11666d-1507-45da-98eb-b4d5a8595fb9" path="/var/lib/kubelet/pods/ce11666d-1507-45da-98eb-b4d5a8595fb9/volumes"
Jul 16 17:10:29.757603 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:29.757570    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:29.758044 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:29.757624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:29.769816 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:29.769793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:29.936568 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:29.936542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:10:40.751163 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751136    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"]
Jul 16 17:10:40.751567 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751526    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b933c85f-d190-402f-95ed-85c7cc8a646c" containerName="main"
Jul 16 17:10:40.751567 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751537    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b933c85f-d190-402f-95ed-85c7cc8a646c" containerName="main"
Jul 16 17:10:40.751567 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751545    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce11666d-1507-45da-98eb-b4d5a8595fb9" containerName="main"
Jul 16 17:10:40.751567 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751550    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce11666d-1507-45da-98eb-b4d5a8595fb9" containerName="main"
Jul 16 17:10:40.751715 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751617    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce11666d-1507-45da-98eb-b4d5a8595fb9" containerName="main"
Jul 16 17:10:40.751715 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.751624    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b933c85f-d190-402f-95ed-85c7cc8a646c" containerName="main"
Jul 16 17:10:40.754500 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.754464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.757583 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.757561    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"openshift-service-ca.crt\""
Jul 16 17:10:40.758555 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.758536    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"default-dockercfg-dwg8q\""
Jul 16 17:10:40.758652 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.758583    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"rate-test-model-734b32-kserve-self-signed-certs\""
Jul 16 17:10:40.758652 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.758624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-734b32\"/\"kube-root-ca.crt\""
Jul 16 17:10:40.769934 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.769913    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"]
Jul 16 17:10:40.794200 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.794170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:10:40.810576 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.810545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bea7337-9b49-492e-b887-ba6bbc298633-tls-certs\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.810715 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.810593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-dshm\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.810715 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.810621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-model-cache\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.810715 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.810666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxzt\" (UniqueName: \"kubernetes.io/projected/0bea7337-9b49-492e-b887-ba6bbc298633-kube-api-access-jzxzt\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.810715 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.810713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-tmp-dir\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.810872 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.810750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-home\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.911601 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.911572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bea7337-9b49-492e-b887-ba6bbc298633-tls-certs\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.911811 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.911622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-dshm\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.911811 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.911643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-model-cache\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.911811 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.911666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxzt\" (UniqueName: \"kubernetes.io/projected/0bea7337-9b49-492e-b887-ba6bbc298633-kube-api-access-jzxzt\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.911811 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.911725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-tmp-dir\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.912062 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.912027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-home\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.912120 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.912067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-model-cache\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.912499 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.912413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-tmp-dir\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.912714 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.912618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-home\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.914179 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.914160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-dshm\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.914423 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.914406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bea7337-9b49-492e-b887-ba6bbc298633-tls-certs\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:40.925512 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:40.925452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxzt\" (UniqueName: \"kubernetes.io/projected/0bea7337-9b49-492e-b887-ba6bbc298633-kube-api-access-jzxzt\") pod \"rate-test-model-734b32-kserve-7f985c6987-w8bg5\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") " pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:41.063425 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:41.063339    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:41.205819 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:41.205794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"]
Jul 16 17:10:41.208395 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:10:41.208365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bea7337_9b49_492e_b887_ba6bbc298633.slice/crio-9882ca95e307c5620f0269ea763155cd32ead73129e6d8f147a4480afc90b38e WatchSource:0}: Error finding container 9882ca95e307c5620f0269ea763155cd32ead73129e6d8f147a4480afc90b38e: Status 404 returned error can't find the container with id 9882ca95e307c5620f0269ea763155cd32ead73129e6d8f147a4480afc90b38e
Jul 16 17:10:41.979374 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:41.979340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5" event={"ID":"0bea7337-9b49-492e-b887-ba6bbc298633","Type":"ContainerStarted","Data":"9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6"}
Jul 16 17:10:41.979800 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:41.979385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5" event={"ID":"0bea7337-9b49-492e-b887-ba6bbc298633","Type":"ContainerStarted","Data":"9882ca95e307c5620f0269ea763155cd32ead73129e6d8f147a4480afc90b38e"}
Jul 16 17:10:41.999810 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:41.999768    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5" podStartSLOduration=1.999755048 podStartE2EDuration="1.999755048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:10:41.998230466 +0000 UTC m=+2717.658469892" watchObservedRunningTime="2026-07-16 17:10:41.999755048 +0000 UTC m=+2717.659994522"
Jul 16 17:10:46.819595 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:46.819562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:10:51.064225 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:51.064169    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:51.064225 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:51.064234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:51.076321 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:51.076298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:10:52.037531 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:10:52.037477    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:11:01.913084 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:01.913047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:11:05.875357 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:05.875294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:05.973854 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:05.973809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:13.978851 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:13.978817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:14.078110 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:14.078080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:17.411473 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:17.411440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:11:25.601790 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:25.601751    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"]
Jul 16 17:11:25.615915 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:25.615885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:26.422014 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:26.421976    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"]
Jul 16 17:11:26.476499 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:26.476454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:31.806665 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:31.806629    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:11:40.622345 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.622252    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf" podUID="8f3766dd-cd87-4081-812a-074772f330c1" containerName="main" containerID="cri-o://df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777" gracePeriod=45
Jul 16 17:11:40.882500 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.882428    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:11:40.927750 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.927721    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt7ts\" (UniqueName: \"kubernetes.io/projected/8f3766dd-cd87-4081-812a-074772f330c1-kube-api-access-tt7ts\") pod \"8f3766dd-cd87-4081-812a-074772f330c1\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") "
Jul 16 17:11:40.927931 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.927757    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-dshm\") pod \"8f3766dd-cd87-4081-812a-074772f330c1\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") "
Jul 16 17:11:40.927931 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.927808    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-home\") pod \"8f3766dd-cd87-4081-812a-074772f330c1\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") "
Jul 16 17:11:40.927931 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.927860    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-model-cache\") pod \"8f3766dd-cd87-4081-812a-074772f330c1\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") "
Jul 16 17:11:40.927931 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.927876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3766dd-cd87-4081-812a-074772f330c1-tls-certs\") pod \"8f3766dd-cd87-4081-812a-074772f330c1\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") "
Jul 16 17:11:40.927931 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.927913    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-tmp-dir\") pod \"8f3766dd-cd87-4081-812a-074772f330c1\" (UID: \"8f3766dd-cd87-4081-812a-074772f330c1\") "
Jul 16 17:11:40.928193 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.928136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-home" (OuterVolumeSpecName: "home") pod "8f3766dd-cd87-4081-812a-074772f330c1" (UID: "8f3766dd-cd87-4081-812a-074772f330c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:40.928193 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.928166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f3766dd-cd87-4081-812a-074772f330c1" (UID: "8f3766dd-cd87-4081-812a-074772f330c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:40.928300 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.928284    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f3766dd-cd87-4081-812a-074772f330c1" (UID: "8f3766dd-cd87-4081-812a-074772f330c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:40.930028 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.930002    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-dshm" (OuterVolumeSpecName: "dshm") pod "8f3766dd-cd87-4081-812a-074772f330c1" (UID: "8f3766dd-cd87-4081-812a-074772f330c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:40.930134 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.930035    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f3766dd-cd87-4081-812a-074772f330c1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f3766dd-cd87-4081-812a-074772f330c1" (UID: "8f3766dd-cd87-4081-812a-074772f330c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:11:40.930413 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:40.930386    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3766dd-cd87-4081-812a-074772f330c1-kube-api-access-tt7ts" (OuterVolumeSpecName: "kube-api-access-tt7ts") pod "8f3766dd-cd87-4081-812a-074772f330c1" (UID: "8f3766dd-cd87-4081-812a-074772f330c1"). InnerVolumeSpecName "kube-api-access-tt7ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:11:41.029039 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.028999    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.029039 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.029032    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.029039 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.029047    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f3766dd-cd87-4081-812a-074772f330c1-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.029278 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.029055    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.029278 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.029063    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt7ts\" (UniqueName: \"kubernetes.io/projected/8f3766dd-cd87-4081-812a-074772f330c1-kube-api-access-tt7ts\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.029278 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.029072    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f3766dd-cd87-4081-812a-074772f330c1-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.247716 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.247628    2564 generic.go:356] "Generic (PLEG): container finished" podID="8f3766dd-cd87-4081-812a-074772f330c1" containerID="df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777" exitCode=0
Jul 16 17:11:41.247716 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.247676    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"
Jul 16 17:11:41.247941 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.247717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf" event={"ID":"8f3766dd-cd87-4081-812a-074772f330c1","Type":"ContainerDied","Data":"df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777"}
Jul 16 17:11:41.247941 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.247765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf" event={"ID":"8f3766dd-cd87-4081-812a-074772f330c1","Type":"ContainerDied","Data":"3014cb8204bcdbd1dda493f48c59a88791d7b1785f248c626cdff852061068fc"}
Jul 16 17:11:41.247941 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.247782    2564 scope.go:117] "RemoveContainer" containerID="df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777"
Jul 16 17:11:41.256435 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.256418    2564 scope.go:117] "RemoveContainer" containerID="df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777"
Jul 16 17:11:41.256738 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:11:41.256717    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777\": container with ID starting with df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777 not found: ID does not exist" containerID="df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777"
Jul 16 17:11:41.256792 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.256744    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777"} err="failed to get container status \"df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777\": rpc error: code = NotFound desc = could not find container \"df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777\": container with ID starting with df0764693c5c906c97dedc8b4d3cef21ee0e7399bbe99743991f81e96161f777 not found: ID does not exist"
Jul 16 17:11:41.273234 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.273207    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"]
Jul 16 17:11:41.283889 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.283866    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0cb2ac/rate-test-model-0cb2ac-kserve-b95849cc9-fllqf"]
Jul 16 17:11:41.441983 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.441938    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5" podUID="0bea7337-9b49-492e-b887-ba6bbc298633" containerName="main" containerID="cri-o://9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6" gracePeriod=45
Jul 16 17:11:41.704247 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.704221    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:11:41.734551 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-dshm\") pod \"0bea7337-9b49-492e-b887-ba6bbc298633\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") "
Jul 16 17:11:41.734760 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bea7337-9b49-492e-b887-ba6bbc298633-tls-certs\") pod \"0bea7337-9b49-492e-b887-ba6bbc298633\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") "
Jul 16 17:11:41.734760 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-tmp-dir\") pod \"0bea7337-9b49-492e-b887-ba6bbc298633\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") "
Jul 16 17:11:41.734760 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-model-cache\") pod \"0bea7337-9b49-492e-b887-ba6bbc298633\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") "
Jul 16 17:11:41.734760 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-home\") pod \"0bea7337-9b49-492e-b887-ba6bbc298633\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") "
Jul 16 17:11:41.734990 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734778    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzxzt\" (UniqueName: \"kubernetes.io/projected/0bea7337-9b49-492e-b887-ba6bbc298633-kube-api-access-jzxzt\") pod \"0bea7337-9b49-492e-b887-ba6bbc298633\" (UID: \"0bea7337-9b49-492e-b887-ba6bbc298633\") "
Jul 16 17:11:41.734990 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.734915    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0bea7337-9b49-492e-b887-ba6bbc298633" (UID: "0bea7337-9b49-492e-b887-ba6bbc298633"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:41.735099 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.735056    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-tmp-dir\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.735155 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.735097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-home" (OuterVolumeSpecName: "home") pod "0bea7337-9b49-492e-b887-ba6bbc298633" (UID: "0bea7337-9b49-492e-b887-ba6bbc298633"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:41.735212 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.735157    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-model-cache" (OuterVolumeSpecName: "model-cache") pod "0bea7337-9b49-492e-b887-ba6bbc298633" (UID: "0bea7337-9b49-492e-b887-ba6bbc298633"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:41.736980 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.736942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-dshm" (OuterVolumeSpecName: "dshm") pod "0bea7337-9b49-492e-b887-ba6bbc298633" (UID: "0bea7337-9b49-492e-b887-ba6bbc298633"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:11:41.737117 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.737097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bea7337-9b49-492e-b887-ba6bbc298633-kube-api-access-jzxzt" (OuterVolumeSpecName: "kube-api-access-jzxzt") pod "0bea7337-9b49-492e-b887-ba6bbc298633" (UID: "0bea7337-9b49-492e-b887-ba6bbc298633"). InnerVolumeSpecName "kube-api-access-jzxzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:11:41.737177 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.737107    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bea7337-9b49-492e-b887-ba6bbc298633-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0bea7337-9b49-492e-b887-ba6bbc298633" (UID: "0bea7337-9b49-492e-b887-ba6bbc298633"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:11:41.835762 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.835672    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-dshm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.835762 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.835704    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bea7337-9b49-492e-b887-ba6bbc298633-tls-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.835762 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.835715    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-model-cache\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.835762 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.835722    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bea7337-9b49-492e-b887-ba6bbc298633-home\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:41.835762 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:41.835731    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzxzt\" (UniqueName: \"kubernetes.io/projected/0bea7337-9b49-492e-b887-ba6bbc298633-kube-api-access-jzxzt\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:42.259167 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.259135    2564 generic.go:356] "Generic (PLEG): container finished" podID="0bea7337-9b49-492e-b887-ba6bbc298633" containerID="9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6" exitCode=0
Jul 16 17:11:42.259341 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.259195    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"
Jul 16 17:11:42.259341 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.259213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5" event={"ID":"0bea7337-9b49-492e-b887-ba6bbc298633","Type":"ContainerDied","Data":"9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6"}
Jul 16 17:11:42.259341 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.259241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5" event={"ID":"0bea7337-9b49-492e-b887-ba6bbc298633","Type":"ContainerDied","Data":"9882ca95e307c5620f0269ea763155cd32ead73129e6d8f147a4480afc90b38e"}
Jul 16 17:11:42.259341 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.259261    2564 scope.go:117] "RemoveContainer" containerID="9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6"
Jul 16 17:11:42.268461 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.268440    2564 scope.go:117] "RemoveContainer" containerID="9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6"
Jul 16 17:11:42.268857 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:11:42.268834    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6\": container with ID starting with 9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6 not found: ID does not exist" containerID="9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6"
Jul 16 17:11:42.268914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.268869    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6"} err="failed to get container status \"9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6\": rpc error: code = NotFound desc = could not find container \"9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6\": container with ID starting with 9c7a2486f6742319c687f57032ec42ff7e00838c24908094e635a0c2b22e7aa6 not found: ID does not exist"
Jul 16 17:11:42.281758 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.281728    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"]
Jul 16 17:11:42.285456 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.285431    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-734b32/rate-test-model-734b32-kserve-7f985c6987-w8bg5"]
Jul 16 17:11:42.674425 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674388    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7376-140485811459104"]
Jul 16 17:11:42.674777 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674765    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bea7337-9b49-492e-b887-ba6bbc298633" containerName="main"
Jul 16 17:11:42.674832 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674778    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bea7337-9b49-492e-b887-ba6bbc298633" containerName="main"
Jul 16 17:11:42.674832 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674794    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3766dd-cd87-4081-812a-074772f330c1" containerName="main"
Jul 16 17:11:42.674832 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674799    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3766dd-cd87-4081-812a-074772f330c1" containerName="main"
Jul 16 17:11:42.674944 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674872    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f3766dd-cd87-4081-812a-074772f330c1" containerName="main"
Jul 16 17:11:42.674944 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.674879    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bea7337-9b49-492e-b887-ba6bbc298633" containerName="main"
Jul 16 17:11:42.679089 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.679071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:42.681696 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.681677    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4d6z2\""
Jul 16 17:11:42.687239 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.687207    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7376-140485811459104"]
Jul 16 17:11:42.743928 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.743897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxn2p\" (UniqueName: \"kubernetes.io/projected/01736c35-8842-4dd6-80b9-396cafdb07c1-kube-api-access-cxn2p\") pod \"test-curl-7376-140485811459104\" (UID: \"01736c35-8842-4dd6-80b9-396cafdb07c1\") " pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:42.844592 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.844543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxn2p\" (UniqueName: \"kubernetes.io/projected/01736c35-8842-4dd6-80b9-396cafdb07c1-kube-api-access-cxn2p\") pod \"test-curl-7376-140485811459104\" (UID: \"01736c35-8842-4dd6-80b9-396cafdb07c1\") " pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:42.854113 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.854083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxn2p\" (UniqueName: \"kubernetes.io/projected/01736c35-8842-4dd6-80b9-396cafdb07c1-kube-api-access-cxn2p\") pod \"test-curl-7376-140485811459104\" (UID: \"01736c35-8842-4dd6-80b9-396cafdb07c1\") " pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:42.874999 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.874969    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bea7337-9b49-492e-b887-ba6bbc298633" path="/var/lib/kubelet/pods/0bea7337-9b49-492e-b887-ba6bbc298633/volumes"
Jul 16 17:11:42.875393 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.875380    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f3766dd-cd87-4081-812a-074772f330c1" path="/var/lib/kubelet/pods/8f3766dd-cd87-4081-812a-074772f330c1/volumes"
Jul 16 17:11:42.988863 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:42.988780    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:43.130027 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:43.130001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7376-140485811459104"]
Jul 16 17:11:43.132701 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:11:43.132676    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01736c35_8842_4dd6_80b9_396cafdb07c1.slice/crio-61a3af1365bd86e387fafb94a01b9fe05afed065d2836501b326d1a7decc9a64 WatchSource:0}: Error finding container 61a3af1365bd86e387fafb94a01b9fe05afed065d2836501b326d1a7decc9a64: Status 404 returned error can't find the container with id 61a3af1365bd86e387fafb94a01b9fe05afed065d2836501b326d1a7decc9a64
Jul 16 17:11:43.133991 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:43.133972    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:11:43.265077 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:43.264990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7376-140485811459104" event={"ID":"01736c35-8842-4dd6-80b9-396cafdb07c1","Type":"ContainerStarted","Data":"61a3af1365bd86e387fafb94a01b9fe05afed065d2836501b326d1a7decc9a64"}
Jul 16 17:11:44.272911 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:44.272877    2564 generic.go:356] "Generic (PLEG): container finished" podID="01736c35-8842-4dd6-80b9-396cafdb07c1" containerID="85e2f85abd99e9738203c6ee45eac0c656b84bab3cabe9553c2c8f89bec4924c" exitCode=0
Jul 16 17:11:44.273294 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:44.272959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7376-140485811459104" event={"ID":"01736c35-8842-4dd6-80b9-396cafdb07c1","Type":"ContainerDied","Data":"85e2f85abd99e9738203c6ee45eac0c656b84bab3cabe9553c2c8f89bec4924c"}
Jul 16 17:11:45.410364 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.410338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:45.438641 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.438614    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7376-140485811459104_01736c35-8842-4dd6-80b9-396cafdb07c1/test-curl-7376-140485811459104/0.log"
Jul 16 17:11:45.466755 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.466722    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7376-140485811459104"]
Jul 16 17:11:45.468683 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.468643    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7376-140485811459104"]
Jul 16 17:11:45.471294 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.471264    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxn2p\" (UniqueName: \"kubernetes.io/projected/01736c35-8842-4dd6-80b9-396cafdb07c1-kube-api-access-cxn2p\") pod \"01736c35-8842-4dd6-80b9-396cafdb07c1\" (UID: \"01736c35-8842-4dd6-80b9-396cafdb07c1\") "
Jul 16 17:11:45.473835 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.473795    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01736c35-8842-4dd6-80b9-396cafdb07c1-kube-api-access-cxn2p" (OuterVolumeSpecName: "kube-api-access-cxn2p") pod "01736c35-8842-4dd6-80b9-396cafdb07c1" (UID: "01736c35-8842-4dd6-80b9-396cafdb07c1"). InnerVolumeSpecName "kube-api-access-cxn2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:11:45.572582 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:45.572461    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxn2p\" (UniqueName: \"kubernetes.io/projected/01736c35-8842-4dd6-80b9-396cafdb07c1-kube-api-access-cxn2p\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:11:46.270149 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:46.270115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:46.283239 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:46.283216    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61a3af1365bd86e387fafb94a01b9fe05afed065d2836501b326d1a7decc9a64"
Jul 16 17:11:46.283239 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:46.283240    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:46.294803 ip-10-0-128-205 kubenswrapper[2564]: E0716 17:11:46.294772    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7376-140485811459104\" is forbidden: User \"system:node:ip-10-0-128-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-205.ec2.internal' and this object" podUID="01736c35-8842-4dd6-80b9-396cafdb07c1" pod="opendatahub/test-curl-7376-140485811459104"
Jul 16 17:11:46.372105 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:46.372073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:46.875101 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:46.875068    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01736c35-8842-4dd6-80b9-396cafdb07c1" path="/var/lib/kubelet/pods/01736c35-8842-4dd6-80b9-396cafdb07c1/volumes"
Jul 16 17:11:47.375091 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:47.375064    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:11:56.608622 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:11:56.608589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:00.115412 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:00.115379    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:12:00.885217 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:00.885181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:07.740162 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:07.740122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:07.857773 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:07.857737    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:12.021932 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.021900    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"]
Jul 16 17:12:12.022417 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.022233    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01736c35-8842-4dd6-80b9-396cafdb07c1" containerName="test-curl-7376-140485811459104"
Jul 16 17:12:12.022417 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.022245    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="01736c35-8842-4dd6-80b9-396cafdb07c1" containerName="test-curl-7376-140485811459104"
Jul 16 17:12:12.022417 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.022334    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="01736c35-8842-4dd6-80b9-396cafdb07c1" containerName="test-curl-7376-140485811459104"
Jul 16 17:12:12.025220 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.025203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:12.028088 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.028060    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dssfh\""
Jul 16 17:12:12.033705 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.033676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"]
Jul 16 17:12:12.103810 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.103773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e9366-80c0-4b06-8921-766772305281-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m\" (UID: \"5d4e9366-80c0-4b06-8921-766772305281\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:12.204275 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.204243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e9366-80c0-4b06-8921-766772305281-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m\" (UID: \"5d4e9366-80c0-4b06-8921-766772305281\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:12.204935 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.204915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e9366-80c0-4b06-8921-766772305281-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m\" (UID: \"5d4e9366-80c0-4b06-8921-766772305281\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:12.336630 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.336543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:12.362201 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.362172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:12.465726 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.465692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:12.474650 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.474629    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"]
Jul 16 17:12:12.477305 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:12:12.477276    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4e9366_80c0_4b06_8921_766772305281.slice/crio-31ad2805a239e4b11ed479b3ca6550b92db492540a5f72d4393fe0ad1185a3df WatchSource:0}: Error finding container 31ad2805a239e4b11ed479b3ca6550b92db492540a5f72d4393fe0ad1185a3df: Status 404 returned error can't find the container with id 31ad2805a239e4b11ed479b3ca6550b92db492540a5f72d4393fe0ad1185a3df
Jul 16 17:12:12.587075 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.586995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:12.687718 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:12.687688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:13.407122 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:13.407082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m" event={"ID":"5d4e9366-80c0-4b06-8921-766772305281","Type":"ContainerStarted","Data":"31ad2805a239e4b11ed479b3ca6550b92db492540a5f72d4393fe0ad1185a3df"}
Jul 16 17:12:16.424597 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:16.424559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m" event={"ID":"5d4e9366-80c0-4b06-8921-766772305281","Type":"ContainerStarted","Data":"b7251c02ef83cb7e876b3ed5fdb48079fda0abf1dc7d5f47ca9e405e08464274"}
Jul 16 17:12:16.445256 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:16.445185    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m" podStartSLOduration=2.165943271 podStartE2EDuration="5.445169292s" totalImagesPullingTime="3.279226021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:12:16.442939513 +0000 UTC m=+2812.103178917" watchObservedRunningTime="2026-07-16 17:12:16.445169292 +0000 UTC m=+2812.105408697"
Jul 16 17:12:17.431907 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:17.431867    2564 generic.go:356] "Generic (PLEG): container finished" podID="5d4e9366-80c0-4b06-8921-766772305281" containerID="b7251c02ef83cb7e876b3ed5fdb48079fda0abf1dc7d5f47ca9e405e08464274" exitCode=0
Jul 16 17:12:17.432262 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:17.431923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m" event={"ID":"5d4e9366-80c0-4b06-8921-766772305281","Type":"ContainerDied","Data":"b7251c02ef83cb7e876b3ed5fdb48079fda0abf1dc7d5f47ca9e405e08464274"}
Jul 16 17:12:18.559986 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:18.559964    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:18.663052 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:18.663023    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e9366-80c0-4b06-8921-766772305281-maas-api-service-ca\") pod \"5d4e9366-80c0-4b06-8921-766772305281\" (UID: \"5d4e9366-80c0-4b06-8921-766772305281\") "
Jul 16 17:12:18.663385 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:18.663360    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4e9366-80c0-4b06-8921-766772305281-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d4e9366-80c0-4b06-8921-766772305281" (UID: "5d4e9366-80c0-4b06-8921-766772305281"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:12:18.764476 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:18.764395    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4e9366-80c0-4b06-8921-766772305281-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 16 17:12:19.448472 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:19.448436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m" event={"ID":"5d4e9366-80c0-4b06-8921-766772305281","Type":"ContainerDied","Data":"31ad2805a239e4b11ed479b3ca6550b92db492540a5f72d4393fe0ad1185a3df"}
Jul 16 17:12:19.448653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:19.448445    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m"
Jul 16 17:12:19.448653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:19.448539    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31ad2805a239e4b11ed479b3ca6550b92db492540a5f72d4393fe0ad1185a3df"
Jul 16 17:12:22.674224 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:22.674192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:25.905653 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:25.905613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nl7sx"]
Jul 16 17:12:27.132082 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:27.132054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:33.712071 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:33.712033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:33.810832 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:33.810802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:37.902809 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:37.902768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:38.136431 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:38.136398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:44.293168 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:44.293141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nxn7r_b399ccd4-79e7-4172-9272-5877975aa6f9/manager/0.log"
Jul 16 17:12:44.410876 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:44.410845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8djf2_8854236d-227a-4a28-bf51-cbdd414480a9/manager/0.log"
Jul 16 17:12:44.656099 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:44.656069    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tqc6k_22262620-38ac-4629-a526-a758fa41430c/server/0.log"
Jul 16 17:12:45.210724 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:45.210695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846bd4c774-x4ht7_abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208/copy-manifests/0.log"
Jul 16 17:12:45.222543 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:45.222514    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846bd4c774-x4ht7_abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208/manager/0.log"
Jul 16 17:12:47.331461 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:47.331427    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-734b32-2lg8m_5d4e9366-80c0-4b06-8921-766772305281/revoke-keys/0.log"
Jul 16 17:12:47.443471 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:47.443446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-42s2n_d2e01328-d62b-413f-945d-bb8ab173f5b3/postgres/0.log"
Jul 16 17:12:48.963761 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:48.963731    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pdssg_72408641-6bac-4f33-ac9c-38c4f86c37fe/manager/0.log"
Jul 16 17:12:49.091048 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:49.091022    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z4pzq_4e38ff0b-c336-40ba-9806-f9222d0695ef/manager/0.log"
Jul 16 17:12:49.221596 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:49.221526    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lmfzq_a85c00e5-c40f-40e1-8149-660b9ada01a9/kuadrant-console-plugin/0.log"
Jul 16 17:12:49.345614 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:49.345582    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-npd96_8514620f-207e-4ad6-ba0a-e6af1d939bd3/registry-server/0.log"
Jul 16 17:12:49.606557 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:49.606451    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nl7sx_4000da2b-26b8-4c82-a09c-e687e237bf60/limitador/0.log"
Jul 16 17:12:49.730806 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:49.730764    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2z2gl_1107cb39-963a-4fd6-b191-e61343d97f95/manager/0.log"
Jul 16 17:12:50.482149 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:50.482119    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6747f69598-h72w9_b60ce27d-4d9a-45fe-83da-60de960420f8/kube-auth-proxy/0.log"
Jul 16 17:12:50.614643 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:50.614617    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/1.log"
Jul 16 17:12:50.863897 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:50.863825    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pw48m_4aad3389-e684-4fc3-8a91-1db6c2d3ef29/payload-processing/0.log"
Jul 16 17:12:51.333012 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:51.332979    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xk6nr_5778f0dd-c09c-4d21-a1b5-05e61fe9476d/main/0.log"
Jul 16 17:12:51.795919 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:51.795879    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-g59lf_6b56f61d-3504-4c7a-9749-b92b0fee2fd4/main/0.log"
Jul 16 17:12:57.636523 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:57.636461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:12:57.729687 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:12:57.729649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:13:00.699621 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:00.699588    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xn5vd_db641f93-d3ba-4314-8fc6-db0e3066abca/global-pull-secret-syncer/0.log"
Jul 16 17:13:00.750820 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:00.750788    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log"
Jul 16 17:13:00.852318 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:00.852291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-205.ec2.internal_442a3b85d0a0c01edd399042a59b86a3/haproxy/0.log"
Jul 16 17:13:05.822377 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:05.822341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pdssg_72408641-6bac-4f33-ac9c-38c4f86c37fe/manager/0.log"
Jul 16 17:13:05.848911 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:05.848883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z4pzq_4e38ff0b-c336-40ba-9806-f9222d0695ef/manager/0.log"
Jul 16 17:13:05.883057 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:05.883030    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lmfzq_a85c00e5-c40f-40e1-8149-660b9ada01a9/kuadrant-console-plugin/0.log"
Jul 16 17:13:05.928940 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:05.928910    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-npd96_8514620f-207e-4ad6-ba0a-e6af1d939bd3/registry-server/0.log"
Jul 16 17:13:06.130583 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:06.130556    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nl7sx_4000da2b-26b8-4c82-a09c-e687e237bf60/limitador/0.log"
Jul 16 17:13:06.208172 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:06.208139    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2z2gl_1107cb39-963a-4fd6-b191-e61343d97f95/manager/0.log"
Jul 16 17:13:08.566830 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:08.566805    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sg22d_e1d8b8e4-7bb7-4674-9059-e722ca5f32cf/node-exporter/0.log"
Jul 16 17:13:08.593273 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:08.593248    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sg22d_e1d8b8e4-7bb7-4674-9059-e722ca5f32cf/kube-rbac-proxy/0.log"
Jul 16 17:13:08.622958 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:08.622934    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sg22d_e1d8b8e4-7bb7-4674-9059-e722ca5f32cf/init-textfile/0.log"
Jul 16 17:13:10.976794 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.976765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"]
Jul 16 17:13:10.977184 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.977106    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4e9366-80c0-4b06-8921-766772305281" containerName="revoke-keys"
Jul 16 17:13:10.977184 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.977117    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4e9366-80c0-4b06-8921-766772305281" containerName="revoke-keys"
Jul 16 17:13:10.977184 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.977179    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4e9366-80c0-4b06-8921-766772305281" containerName="revoke-keys"
Jul 16 17:13:10.980040 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.980022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:10.982973 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.982949    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84tj4\"/\"openshift-service-ca.crt\""
Jul 16 17:13:10.983792 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.983774    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84tj4\"/\"kube-root-ca.crt\""
Jul 16 17:13:10.983866 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.983773    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-84tj4\"/\"default-dockercfg-c7czs\""
Jul 16 17:13:10.997081 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:10.997058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"]
Jul 16 17:13:11.119074 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.119037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-proc\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.119074 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.119072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-podres\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.119283 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.119090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-sys\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.119283 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.119115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmds6\" (UniqueName: \"kubernetes.io/projected/b9bed441-65f1-40fc-b8d8-fa8a87145089-kube-api-access-zmds6\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.119283 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.119177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-lib-modules\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219720 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-lib-modules\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-proc\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-podres\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-sys\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmds6\" (UniqueName: \"kubernetes.io/projected/b9bed441-65f1-40fc-b8d8-fa8a87145089-kube-api-access-zmds6\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-proc\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-sys\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-lib-modules\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.219914 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.219871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9bed441-65f1-40fc-b8d8-fa8a87145089-podres\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.229641 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.229579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmds6\" (UniqueName: \"kubernetes.io/projected/b9bed441-65f1-40fc-b8d8-fa8a87145089-kube-api-access-zmds6\") pod \"perf-node-gather-daemonset-47xxl\" (UID: \"b9bed441-65f1-40fc-b8d8-fa8a87145089\") " pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.290746 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.290708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.441711 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.441682    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"]
Jul 16 17:13:11.444050 ip-10-0-128-205 kubenswrapper[2564]: W0716 17:13:11.444022    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9bed441_65f1_40fc_b8d8_fa8a87145089.slice/crio-e09707a8f3b0e9aebbed700a860813c9e87e3a940ea742394a32b00071b98c1f WatchSource:0}: Error finding container e09707a8f3b0e9aebbed700a860813c9e87e3a940ea742394a32b00071b98c1f: Status 404 returned error can't find the container with id e09707a8f3b0e9aebbed700a860813c9e87e3a940ea742394a32b00071b98c1f
Jul 16 17:13:11.682576 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.682540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl" event={"ID":"b9bed441-65f1-40fc-b8d8-fa8a87145089","Type":"ContainerStarted","Data":"aaceb899d235017f75f31b1f5ff49b925adf42453e4632ff9d5bdb999ffc4fec"}
Jul 16 17:13:11.682745 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.682605    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl" event={"ID":"b9bed441-65f1-40fc-b8d8-fa8a87145089","Type":"ContainerStarted","Data":"e09707a8f3b0e9aebbed700a860813c9e87e3a940ea742394a32b00071b98c1f"}
Jul 16 17:13:11.682745 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.682633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:11.711451 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:11.711401    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl" podStartSLOduration=1.71138719 podStartE2EDuration="1.71138719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:13:11.708937347 +0000 UTC m=+2867.369176768" watchObservedRunningTime="2026-07-16 17:13:11.71138719 +0000 UTC m=+2867.371626593"
Jul 16 17:13:13.874192 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:13.874164    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhhjh_4bdd8ed0-8e1d-451b-9f3b-06c864aac49d/dns/0.log"
Jul 16 17:13:13.896556 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:13.896531    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhhjh_4bdd8ed0-8e1d-451b-9f3b-06c864aac49d/kube-rbac-proxy/0.log"
Jul 16 17:13:13.972203 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:13.972178    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z7d6s_5bc7f455-cf30-43d8-897c-eada57e25cba/dns-node-resolver/0.log"
Jul 16 17:13:14.548350 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:14.548320    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6ff8599596-4bmx8_773c1781-6b26-40b1-858b-b1506f676bd3/registry/0.log"
Jul 16 17:13:14.613019 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:14.612990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8gskh_019c710d-5993-4ff8-a706-793f1769945c/node-ca/0.log"
Jul 16 17:13:15.899695 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:15.899601    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6747f69598-h72w9_b60ce27d-4d9a-45fe-83da-60de960420f8/kube-auth-proxy/0.log"
Jul 16 17:13:15.928147 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:15.928111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/0.log"
Jul 16 17:13:15.956574 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:15.956547    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/1.log"
Jul 16 17:13:16.026723 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:16.026677    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pw48m_4aad3389-e684-4fc3-8a91-1db6c2d3ef29/payload-processing/0.log"
Jul 16 17:13:16.751043 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:16.751002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5w697_6b184a6a-f5ca-4852-b699-c22eb47103d6/serve-healthcheck-canary/0.log"
Jul 16 17:13:17.411927 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:17.411879    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9bqqw_c4ab4d56-2329-42cc-a6bc-410c032fd56e/kube-rbac-proxy/0.log"
Jul 16 17:13:17.435233 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:17.435205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9bqqw_c4ab4d56-2329-42cc-a6bc-410c032fd56e/exporter/0.log"
Jul 16 17:13:17.457405 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:17.457382    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9bqqw_c4ab4d56-2329-42cc-a6bc-410c032fd56e/extractor/0.log"
Jul 16 17:13:17.698805 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:17.698727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-84tj4/perf-node-gather-daemonset-47xxl"
Jul 16 17:13:19.627774 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:19.627743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:13:19.790981 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:19.790944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:13:19.914581 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:19.914470    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nxn7r_b399ccd4-79e7-4172-9272-5877975aa6f9/manager/0.log"
Jul 16 17:13:19.997013 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:19.996978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:13:20.060238 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:20.060208    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8djf2_8854236d-227a-4a28-bf51-cbdd414480a9/manager/0.log"
Jul 16 17:13:20.114729 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:20.114699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hl8xp_54252c07-45d8-4724-b24a-e8a535573b8b/konnectivity-agent/0.log" limit=1024
Jul 16 17:13:20.219090 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:20.218996    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tqc6k_22262620-38ac-4629-a526-a758fa41430c/server/0.log"
Jul 16 17:13:20.505195 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:20.505156    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846bd4c774-x4ht7_abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208/manager/0.log"
Jul 16 17:13:20.527754 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:20.527727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846bd4c774-x4ht7_abaaf1ca-b3c3-447c-a81f-9d6e3f9dc208/copy-manifests/0.log"
Jul 16 17:13:22.153902 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:22.153875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6747f69598-h72w9_b60ce27d-4d9a-45fe-83da-60de960420f8/kube-auth-proxy/0.log"
Jul 16 17:13:22.177522 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:22.177473    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/0.log"
Jul 16 17:13:22.205800 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:22.205767    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/1.log"
Jul 16 17:13:22.258747 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:22.258715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pw48m_4aad3389-e684-4fc3-8a91-1db6c2d3ef29/payload-processing/0.log"
Jul 16 17:13:23.840687 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:23.840654    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6747f69598-h72w9_b60ce27d-4d9a-45fe-83da-60de960420f8/kube-auth-proxy/0.log"
Jul 16 17:13:23.872637 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:23.872591    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/0.log"
Jul 16 17:13:23.906434 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:23.906397    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mxsn4_94539fa2-827f-4e7f-90a8-c9c846b78917/istio-proxy/1.log"
Jul 16 17:13:23.956559 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:23.956529    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-pw48m_4aad3389-e684-4fc3-8a91-1db6c2d3ef29/payload-processing/0.log"
Jul 16 17:13:27.398383 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:27.398318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xvfc8_4df98561-995e-4d2e-9411-991e6cb4103d/migrator/0.log"
Jul 16 17:13:27.422725 ip-10-0-128-205 kubenswrapper[2564]: I0716 17:13:27.422700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xvfc8_4df98561-995e-4d2e-9411-991e6cb4103d/graceful-termination/0.log"